[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:07 dist-test-slave-7lbf krb5kdc[22297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:07 dist-test-slave-7lbf krb5kdc[22297](info): set up 2 sockets
Aug 10 06:30:07 dist-test-slave-7lbf krb5kdc[22297](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 06:30:09.002888 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.009s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:09 dist-test-slave-7lbf krb5kdc[22297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:09.151867 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:40851
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:40851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:09.304587 22328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:09.304956 22328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:09.305022 22328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:09.309324 22328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:09.309427 22328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:09.309455 22328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:09.309477 22328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:09.309497 22328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:09.315798 22328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:40851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:40851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:09.317612 22328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:09.319183 22328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:09.334249 22334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:09.335104 22333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:09.335222 22339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:09.336145 22328 server_base.cc:1034] running on GCE node
I20260810 06:30:09.337163 22328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:09.339470 22328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:09.340764 22328 hybrid_clock.cc:648] HybridClock initialized: now 1786343409340720 us; error 71 us; skew 500 ppm
Aug 10 06:30:09 dist-test-slave-7lbf krb5kdc[22297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343409, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:09.344277 22328 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:09.345927 22328 webserver.cc:460] Webserver started at http://127.21.195.254:37459/ using document root <none> and password file <none>
I20260810 06:30:09.347034 22328 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:09.347126 22328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:09.347579 22328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:09.351029 22328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "29007d790c7545408f85a9e42d39dbda"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "c9be90ef103146ce5f22a768a91819f1"
server_key_iv: "e9fba5e1d173135db8af0e4d5109ed2f"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.352097 22328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "29007d790c7545408f85a9e42d39dbda"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "c9be90ef103146ce5f22a768a91819f1"
server_key_iv: "e9fba5e1d173135db8af0e4d5109ed2f"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.358273 22328 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260810 06:30:09.362785 22350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:09.364761 22328 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:09.364962 22328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "29007d790c7545408f85a9e42d39dbda"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "c9be90ef103146ce5f22a768a91819f1"
server_key_iv: "e9fba5e1d173135db8af0e4d5109ed2f"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.365113 22328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:09.394693 22328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:09.399132 22328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:09.399420 22328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:09.410868 22328 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:40851
I20260810 06:30:09.410981 22437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:40851 every 8 connection(s)
I20260810 06:30:09.412580 22328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:09.418581 22438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:09.422878 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22328
I20260810 06:30:09.423074 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:09.424955 22287 external_mini_cluster.cc:1428] Setting key e394bac53a1b6ce475088d42833233db
I20260810 06:30:09.429071 22438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda: Bootstrap starting.
I20260810 06:30:09.434197 22438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:09.435536 22438 log.cc:824] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:09.438637 22438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda: No bootstrap required, opened a new log
I20260810 06:30:09.443773 22438 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29007d790c7545408f85a9e42d39dbda" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40851 } }
I20260810 06:30:09.444183 22438 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:09.444284 22438 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29007d790c7545408f85a9e42d39dbda, State: Initialized, Role: FOLLOWER
I20260810 06:30:09.445254 22438 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29007d790c7545408f85a9e42d39dbda" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40851 } }
I20260810 06:30:09.445475 22438 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:09.445662 22438 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:09.445833 22438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:09.447047 22438 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29007d790c7545408f85a9e42d39dbda" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40851 } }
Aug 10 06:30:09 dist-test-slave-7lbf krb5kdc[22297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:09.447772 22438 leader_election.cc:302] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29007d790c7545408f85a9e42d39dbda; no voters:
I20260810 06:30:09.448201 22438 leader_election.cc:288] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:09.448335 22447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:09.448544 22447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [term 1 LEADER]: Becoming Leader. State: Replica: 29007d790c7545408f85a9e42d39dbda, State: Running, Role: LEADER
I20260810 06:30:09.449008 22447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29007d790c7545408f85a9e42d39dbda" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40851 } }
I20260810 06:30:09.450177 22438 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:09.452170 22449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29007d790c7545408f85a9e42d39dbda. Latest consensus state: current_term: 1 leader_uuid: "29007d790c7545408f85a9e42d39dbda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29007d790c7545408f85a9e42d39dbda" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40851 } } }
I20260810 06:30:09.452328 22449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:09.452754 22448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29007d790c7545408f85a9e42d39dbda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29007d790c7545408f85a9e42d39dbda" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40851 } } }
I20260810 06:30:09.452858 22448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:09.456562 22441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:09.430417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35370 (local address 127.21.195.254:40851)
0810 06:30:09.431014 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:09.431033 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:09.432258 (+ 1225us) server_negotiation.cc:407] Connection header received
0810 06:30:09.435966 (+ 3708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:09.435988 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:09.436470 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:09.436838 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:09.439655 (+ 2817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:09.441096 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:09.442704 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:09.443285 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:09.443514 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:09.448459 (+ 4945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:09.448512 (+ 53us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:09.448536 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:09.448583 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:09.450641 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:09.451365 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:09.451371 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:09.451378 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:09.451570 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:09.452052 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:09.452055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:09.452057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:09.452800 (+ 743us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:09.453025 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:09.455162 (+ 2137us) server_negotiation.cc:299] Negotiation successful
0810 06:30:09.455425 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":150,"threads_started":1}
W20260810 06:30:09.458155 22467 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:30:09.458279 22467 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:30:09.458526 22463 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:09.459509 22463 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:09.467445 22463 catalog_manager.cc:1347] Generated new cluster ID: 82a29d82dd2e406c801aaed00bb02837
I20260810 06:30:09.467556 22463 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:09.477480 22463 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:09.479099 22463 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:09.486526 22463 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29007d790c7545408f85a9e42d39dbda: Generated new TSK 0
I20260810 06:30:09.487782 22463 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:09.524360 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40851
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:09.662580 22476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:09.662911 22476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:09.662961 22476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:09.667276 22476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:09.667364 22476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:09.667436 22476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:09.673451 22476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40851
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:09.674862 22476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:09.676054 22476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:09.687944 22487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:09.687970 22489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:09.688054 22493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:09.688030 22476 server_base.cc:1034] running on GCE node
I20260810 06:30:09.688656 22476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:09.689499 22476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:09.690732 22476 hybrid_clock.cc:648] HybridClock initialized: now 1786343409690706 us; error 42 us; skew 500 ppm
Aug 10 06:30:09 dist-test-slave-7lbf krb5kdc[22297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343409, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:09.693776 22476 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:09.694919 22476 webserver.cc:460] Webserver started at http://127.21.195.193:38785/ using document root <none> and password file <none>
I20260810 06:30:09.695559 22476 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:09.695636 22476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:09.695875 22476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:09.698295 22476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "bf40705e81df41449ff56da309cef5de"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "6c6a03c9cfbaa0fd23dc37672ba7649b"
server_key_iv: "8bc60d169ac4a52f2a014fadf8265f7e"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.698942 22476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "bf40705e81df41449ff56da309cef5de"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "6c6a03c9cfbaa0fd23dc37672ba7649b"
server_key_iv: "8bc60d169ac4a52f2a014fadf8265f7e"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.703514 22476 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 06:30:09.706360 22505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:09.707777 22476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:09.707928 22476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "bf40705e81df41449ff56da309cef5de"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "6c6a03c9cfbaa0fd23dc37672ba7649b"
server_key_iv: "8bc60d169ac4a52f2a014fadf8265f7e"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.708051 22476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:09.726151 22476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:09.729799 22476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:09.730036 22476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:09.730922 22476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:09.732308 22476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:09.732374 22476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:09.732443 22476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:09.732478 22476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:09.747076 22476 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:46727
I20260810 06:30:09.747110 22690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:46727 every 8 connection(s)
I20260810 06:30:09.748160 22476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:09.753332 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22476
I20260810 06:30:09.753450 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:09.753757 22287 external_mini_cluster.cc:1428] Setting key 464029e3e5908ad709f61d4d018d4eb1
Aug 10 06:30:09 dist-test-slave-7lbf krb5kdc[22297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343409, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:09.765793 22441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:09.751169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:59339 (local address 127.21.195.254:40851)
0810 06:30:09.751349 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:09.751353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:09.752603 (+ 1250us) server_negotiation.cc:407] Connection header received
0810 06:30:09.754474 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:09.754477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:09.754532 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:09.754615 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:09.756056 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:09.756802 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:09.758478 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:09.758738 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:09.758825 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:09.761968 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:09.761972 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:09.761974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:09.762003 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:09.763396 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:09.763991 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:09.763994 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:09.763995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:09.764093 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:09.764470 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:09.764473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:09.764474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:09.764713 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:09.764806 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:09.765429 (+ 623us) server_negotiation.cc:299] Negotiation successful
0810 06:30:09.765612 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 06:30:09.766891 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:09.751706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:40851 (local address 127.21.195.193:59339)
0810 06:30:09.752423 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:09.752478 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:09.754217 (+ 1739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:09.754798 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:09.754807 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:09.755297 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:09.755882 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:09.755907 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:09.756933 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:09.756936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:09.758347 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:09.758361 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:09.758919 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:09.758924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:09.759150 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:09.759759 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:09.759783 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:09.761763 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:09.763531 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:09.763539 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:09.763561 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:09.763860 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:09.764187 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:09.764190 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:09.764192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:09.764364 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:09.764827 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:09.764835 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:09.765150 (+ 315us) client_negotiation.cc:769] Sending connection context
0810 06:30:09.765342 (+ 192us) client_negotiation.cc:240] Negotiation successful
0810 06:30:09.765785 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":240,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:09.768517 22691 heartbeater.cc:347] Connected to a master server at 127.21.195.254:40851
I20260810 06:30:09.768831 22691 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:09.769611 22691 heartbeater.cc:511] Master 127.21.195.254:40851 requested a full tablet report, sending...
I20260810 06:30:09.772192 22377 ts_manager.cc:194] Registered new tserver with Master: bf40705e81df41449ff56da309cef5de (127.21.195.193:46727)
I20260810 06:30:09.773973 22377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:59339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:09.786070 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40851
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:09.925421 22699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:09.925772 22699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:09.925818 22699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:09.930085 22699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:09.930181 22699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:09.930272 22699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:09.936343 22699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40851
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:09.937731 22699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:09.939085 22699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:09.950517 22705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:09.950613 22704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:09.950656 22707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:09.950799 22699 server_base.cc:1034] running on GCE node
I20260810 06:30:09.951344 22699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:09.952128 22699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:09.953298 22699 hybrid_clock.cc:648] HybridClock initialized: now 1786343409953274 us; error 40 us; skew 500 ppm
Aug 10 06:30:09 dist-test-slave-7lbf krb5kdc[22297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343409, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:09.956355 22699 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:09.957325 22699 webserver.cc:460] Webserver started at http://127.21.195.194:38475/ using document root <none> and password file <none>
I20260810 06:30:09.957975 22699 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:09.958045 22699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:09.958238 22699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:09.960698 22699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "6a2dc47f8d164e0ea816fd4f2963d73e"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "f5e0589b8e4fda2005964cd9dd8c9c5c"
server_key_iv: "f4933fc4ceb305b2afa28be91e2f7741"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.961385 22699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "6a2dc47f8d164e0ea816fd4f2963d73e"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "f5e0589b8e4fda2005964cd9dd8c9c5c"
server_key_iv: "f4933fc4ceb305b2afa28be91e2f7741"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.965823 22699 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 06:30:09.968654 22718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:09.970158 22699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:09.970281 22699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "6a2dc47f8d164e0ea816fd4f2963d73e"
format_stamp: "Formatted at 2026-08-10 06:30:09 on dist-test-slave-7lbf"
server_key: "f5e0589b8e4fda2005964cd9dd8c9c5c"
server_key_iv: "f4933fc4ceb305b2afa28be91e2f7741"
server_key_version: "encryptionkey@0"
I20260810 06:30:09.970404 22699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:09.988444 22699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:09.992221 22699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:09.992511 22699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:09.993371 22699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:09.994504 22699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:09.994568 22699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:09.994625 22699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:09.994655 22699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:10.007273 22699 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:45525
I20260810 06:30:10.007308 22888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:45525 every 8 connection(s)
I20260810 06:30:10.008435 22699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:10.015288 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22699
I20260810 06:30:10.015408 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:10.015693 22287 external_mini_cluster.cc:1428] Setting key dfca72b1a465f00a2fbc66f3f7a6b676
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[22297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343409, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:10.025005 22441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:10.010714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:55863 (local address 127.21.195.254:40851)
0810 06:30:10.010876 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:10.010880 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:10.011968 (+ 1088us) server_negotiation.cc:407] Connection header received
0810 06:30:10.013449 (+ 1481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:10.013453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:10.013546 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:10.013629 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:10.015489 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.016083 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.017662 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.017890 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.017984 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:10.020912 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:10.020915 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:10.020918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:10.020948 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:10.022600 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:10.023218 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:10.023222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:10.023224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:10.023338 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:10.023702 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:10.023706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:10.023707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:10.023972 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:10.024086 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:10.024650 (+ 564us) server_negotiation.cc:299] Negotiation successful
0810 06:30:10.024815 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 06:30:10.026031 22893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:10.011186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:40851 (local address 127.21.195.194:55863)
0810 06:30:10.011776 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:10.011844 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:10.013201 (+ 1357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:10.013876 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:10.013885 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:10.014498 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:10.015298 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:10.015317 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.016236 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.016241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:10.017509 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:10.017545 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.018050 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.018054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:10.018243 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:10.018886 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:10.018906 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:10.020664 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:10.022739 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:10.022746 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:10.022763 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:10.023080 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:10.023444 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:10.023446 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:10.023447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:10.023616 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:10.024072 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:10.024079 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:10.024375 (+ 296us) client_negotiation.cc:769] Sending connection context
0810 06:30:10.024565 (+ 190us) client_negotiation.cc:240] Negotiation successful
0810 06:30:10.024880 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":179,"threads_started":1}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:30:10.027453 22890 heartbeater.cc:347] Connected to a master server at 127.21.195.254:40851
I20260810 06:30:10.027776 22890 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:10.028398 22890 heartbeater.cc:511] Master 127.21.195.254:40851 requested a full tablet report, sending...
I20260810 06:30:10.029660 22377 ts_manager.cc:194] Registered new tserver with Master: 6a2dc47f8d164e0ea816fd4f2963d73e (127.21.195.194:45525)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:30:10.030328 22377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:55863
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:10.046957 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40851
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:10.186719 22897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:10.187069 22897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:10.187139 22897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:10.191440 22897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:10.191541 22897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:10.191633 22897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:10.197803 22897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40851
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:10.199136 22897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:10.200357 22897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:10.211540 22906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:10.211582 22909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:10.211706 22897 server_base.cc:1034] running on GCE node
W20260810 06:30:10.211913 22903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:10.212356 22897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:10.213160 22897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:10.214326 22897 hybrid_clock.cc:648] HybridClock initialized: now 1786343410214302 us; error 38 us; skew 500 ppm
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[22297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343410, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:10.217432 22897 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:10.218485 22897 webserver.cc:460] Webserver started at http://127.21.195.195:42189/ using document root <none> and password file <none>
I20260810 06:30:10.219120 22897 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:10.219189 22897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:10.219424 22897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:10.221963 22897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "038d230383474a7db23f9531dce7a32c"
format_stamp: "Formatted at 2026-08-10 06:30:10 on dist-test-slave-7lbf"
server_key: "7798b3155a4df1fae4bfb8e55ce76efc"
server_key_iv: "61e38472ecf73d3b93db76dccc16cc32"
server_key_version: "encryptionkey@0"
I20260810 06:30:10.222677 22897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "038d230383474a7db23f9531dce7a32c"
format_stamp: "Formatted at 2026-08-10 06:30:10 on dist-test-slave-7lbf"
server_key: "7798b3155a4df1fae4bfb8e55ce76efc"
server_key_iv: "61e38472ecf73d3b93db76dccc16cc32"
server_key_version: "encryptionkey@0"
I20260810 06:30:10.227650 22897 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 06:30:10.230515 22918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:10.231980 22897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:10.232115 22897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "038d230383474a7db23f9531dce7a32c"
format_stamp: "Formatted at 2026-08-10 06:30:10 on dist-test-slave-7lbf"
server_key: "7798b3155a4df1fae4bfb8e55ce76efc"
server_key_iv: "61e38472ecf73d3b93db76dccc16cc32"
server_key_version: "encryptionkey@0"
I20260810 06:30:10.232239 22897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:10.249445 22897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:10.253078 22897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:10.253293 22897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:10.254017 22897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:10.255002 22897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:10.255054 22897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:10.255115 22897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:10.255142 22897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:10.270339 22897 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:39937
I20260810 06:30:10.270360 23105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:39937 every 8 connection(s)
I20260810 06:30:10.271438 22897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:10.276033 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22897
I20260810 06:30:10.276171 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:10.276449 22287 external_mini_cluster.cc:1428] Setting key 5db2993f7067dbd0ce9592cf76cd44d6
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[22297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343410, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:10.286772 22441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:10.273631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:47313 (local address 127.21.195.254:40851)
0810 06:30:10.273800 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:10.273805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:10.275223 (+ 1418us) server_negotiation.cc:407] Connection header received
0810 06:30:10.276788 (+ 1565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:10.276792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:10.276858 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:10.276985 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:10.278816 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.279376 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.280656 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.280910 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.281003 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:10.283584 (+ 2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:10.283587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:10.283589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:10.283617 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:10.284789 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:10.285288 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:10.285291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:10.285292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:10.285364 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:10.285717 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:10.285720 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:10.285721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:10.285927 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:10.286004 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:10.286524 (+ 520us) server_negotiation.cc:299] Negotiation successful
0810 06:30:10.286635 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:30:10.287750 23109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:10.274275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:40851 (local address 127.21.195.195:47313)
0810 06:30:10.274994 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:10.275061 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:10.276514 (+ 1453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:10.277237 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:10.277247 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:10.277873 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:10.278626 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:10.278653 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.279520 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.279524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:10.280516 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:10.280528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.281060 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.281063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:10.281231 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:10.281855 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:10.281874 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:10.283404 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:10.284905 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:10.284911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:10.284926 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:10.285204 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:10.285431 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:10.285433 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:10.285434 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:10.285636 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:10.286015 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:10.286022 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:10.286305 (+ 283us) client_negotiation.cc:769] Sending connection context
0810 06:30:10.286486 (+ 181us) client_negotiation.cc:240] Negotiation successful
0810 06:30:10.286788 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":201,"threads_started":1}
I20260810 06:30:10.289142 23106 heartbeater.cc:347] Connected to a master server at 127.21.195.254:40851
I20260810 06:30:10.289420 23106 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:10.290043 23106 heartbeater.cc:511] Master 127.21.195.254:40851 requested a full tablet report, sending...
I20260810 06:30:10.291311 22377 ts_manager.cc:194] Registered new tserver with Master: 038d230383474a7db23f9531dce7a32c (127.21.195.195:39937)
I20260810 06:30:10.291780 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:30:10.291972 22377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:47313
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[22297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343410, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[22297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343410, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:10.322458 23118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:10.312486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56224 (local address 127.21.195.193:46727)
0810 06:30:10.312893 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:10.312901 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:10.312932 (+ 31us) server_negotiation.cc:407] Connection header received
0810 06:30:10.313080 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:10.313085 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:10.313301 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:10.313438 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:10.314164 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.314966 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.315854 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.316271 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.316355 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:10.318851 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:10.318870 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:10.318887 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:10.318919 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:10.320585 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:10.321034 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:10.321040 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:10.321041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:10.321132 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:10.321333 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:10.321334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:10.321335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:10.321667 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:10.321868 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:10.322106 (+ 238us) server_negotiation.cc:299] Negotiation successful
0810 06:30:10.322262 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":102,"threads_started":1}
W20260810 06:30:10.323696 22558 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56224
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[22297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[22297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:10.354121 23118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:10.345375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56238 (local address 127.21.195.193:46727)
0810 06:30:10.345601 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:10.345606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:10.345678 (+ 72us) server_negotiation.cc:407] Connection header received
0810 06:30:10.345858 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:10.345861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:10.345913 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:10.345996 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:10.346746 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.347348 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.348200 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:10.348458 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:10.348545 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:10.351138 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:10.351143 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:10.351145 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:10.351177 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:10.352467 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:10.352884 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:10.352887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:10.352889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:10.352987 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:10.353261 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:10.353264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:10.353265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:10.353476 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:10.353639 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:10.353864 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 06:30:10.353985 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260810 06:30:10.355482 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22476
I20260810 06:30:10.371547 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22699
I20260810 06:30:10.387507 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22897
I20260810 06:30:10.416193 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22328
2026-08-10T06:30:10Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2740 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[23128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[23128](info): set up 2 sockets
Aug 10 06:30:10 dist-test-slave-7lbf krb5kdc[23128](info): commencing operation
krb5kdc: starting...
W20260810 06:30:11.604609 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:11 dist-test-slave-7lbf krb5kdc[23128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343411, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:11.732115 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:34767
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:34767
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:11.855585 23153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:11.855922 23153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:11.855985 23153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:11.860522 23153 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:11.860623 23153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:11.860652 23153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:11.860674 23153 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:11.860697 23153 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:11.866564 23153 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:34767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:34767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:11.867851 23153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:11.869027 23153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:11.878458 23165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:11.878472 23163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:11.878472 23160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:11.878752 23153 server_base.cc:1034] running on GCE node
I20260810 06:30:11.879444 23153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:11.880724 23153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:11.881883 23153 hybrid_clock.cc:648] HybridClock initialized: now 1786343411881857 us; error 41 us; skew 500 ppm
Aug 10 06:30:11 dist-test-slave-7lbf krb5kdc[23128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343411, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:11.884830 23153 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:11.885867 23153 webserver.cc:460] Webserver started at http://127.21.195.254:35391/ using document root <none> and password file <none>
I20260810 06:30:11.886458 23153 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:11.886530 23153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:11.886760 23153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:11.889007 23153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "ca66033f0e4245cb93b4435a2bd0df3b"
format_stamp: "Formatted at 2026-08-10 06:30:11 on dist-test-slave-7lbf"
server_key: "e2c9ce6795b20a09fc8dc6041be921c9"
server_key_iv: "ce673b4bfdb36c7e29dac15e2be64a09"
server_key_version: "encryptionkey@0"
I20260810 06:30:11.889657 23153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "ca66033f0e4245cb93b4435a2bd0df3b"
format_stamp: "Formatted at 2026-08-10 06:30:11 on dist-test-slave-7lbf"
server_key: "e2c9ce6795b20a09fc8dc6041be921c9"
server_key_iv: "ce673b4bfdb36c7e29dac15e2be64a09"
server_key_version: "encryptionkey@0"
I20260810 06:30:11.893796 23153 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:11.896425 23176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:11.897810 23153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:11.897943 23153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "ca66033f0e4245cb93b4435a2bd0df3b"
format_stamp: "Formatted at 2026-08-10 06:30:11 on dist-test-slave-7lbf"
server_key: "e2c9ce6795b20a09fc8dc6041be921c9"
server_key_iv: "ce673b4bfdb36c7e29dac15e2be64a09"
server_key_version: "encryptionkey@0"
I20260810 06:30:11.898056 23153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:11.913161 23153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:11.916433 23153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:11.916651 23153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:11.924309 23153 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:34767
I20260810 06:30:11.924316 23260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:34767 every 8 connection(s)
I20260810 06:30:11.925390 23153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:11.928838 23263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:11.930110 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23153
I20260810 06:30:11.930229 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:11.930577 22287 external_mini_cluster.cc:1428] Setting key c8e3e44dbf982023d6a7ec2e31c30be3
I20260810 06:30:11.935762 23263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b: Bootstrap starting.
I20260810 06:30:11.938452 23263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:11.939467 23263 log.cc:824] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:30:11 dist-test-slave-7lbf krb5kdc[23128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343411, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:11.941912 23263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b: No bootstrap required, opened a new log
I20260810 06:30:11.945382 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:11.932207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52368 (local address 127.21.195.254:34767)
0810 06:30:11.932694 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:11.932710 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:11.932748 (+ 38us) server_negotiation.cc:407] Connection header received
0810 06:30:11.933436 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:11.933455 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:11.933868 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:11.934211 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:11.935057 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:11.936100 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:11.936977 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:11.937483 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:11.937654 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:11.940618 (+ 2964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:11.940624 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:11.940640 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:11.940669 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:11.942386 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:11.942845 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:11.942851 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:11.942856 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:11.942981 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:11.943269 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:11.943272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:11.943273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:11.943719 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:11.943912 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:11.944258 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 06:30:11.944584 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":159,"threads_started":1}
I20260810 06:30:11.946354 23263 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca66033f0e4245cb93b4435a2bd0df3b" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34767 } }
I20260810 06:30:11.946673 23263 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:11.946749 23263 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca66033f0e4245cb93b4435a2bd0df3b, State: Initialized, Role: FOLLOWER
I20260810 06:30:11.947228 23263 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca66033f0e4245cb93b4435a2bd0df3b" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34767 } }
I20260810 06:30:11.947366 23263 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:11.947429 23263 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:11.947530 23263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:11.948675 23263 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca66033f0e4245cb93b4435a2bd0df3b" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34767 } }
I20260810 06:30:11.949045 23263 leader_election.cc:302] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca66033f0e4245cb93b4435a2bd0df3b; no voters:
I20260810 06:30:11.949384 23263 leader_election.cc:288] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:11.949532 23270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:11.949745 23270 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [term 1 LEADER]: Becoming Leader. State: Replica: ca66033f0e4245cb93b4435a2bd0df3b, State: Running, Role: LEADER
I20260810 06:30:11.950093 23270 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca66033f0e4245cb93b4435a2bd0df3b" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34767 } }
I20260810 06:30:11.950910 23263 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:11.951993 23277 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca66033f0e4245cb93b4435a2bd0df3b. Latest consensus state: current_term: 1 leader_uuid: "ca66033f0e4245cb93b4435a2bd0df3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca66033f0e4245cb93b4435a2bd0df3b" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34767 } } }
I20260810 06:30:11.952143 23277 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:11.952529 23287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:11.952519 23276 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca66033f0e4245cb93b4435a2bd0df3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca66033f0e4245cb93b4435a2bd0df3b" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34767 } } }
I20260810 06:30:11.952647 23276 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:11.956092 23287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:11.962620 23287 catalog_manager.cc:1347] Generated new cluster ID: e729b9760748439dacba0ba0e903a684
I20260810 06:30:11.962720 23287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:11.976889 23287 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:11.978498 23287 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:11.985270 23287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca66033f0e4245cb93b4435a2bd0df3b: Generated new TSK 0
I20260810 06:30:11.986122 23287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:12.014789 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34767
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:12.145332 23307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:12.145982 23307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:12.146078 23307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:12.150856 23307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:12.150943 23307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:12.151034 23307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:12.159018 23307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34767
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:12.160738 23307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:12.162129 23307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:12.174803 23314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:12.174803 23323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:12.174803 23315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:12.177605 23307 server_base.cc:1034] running on GCE node
I20260810 06:30:12.178148 23307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:12.179028 23307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:12.180205 23307 hybrid_clock.cc:648] HybridClock initialized: now 1786343412180176 us; error 58 us; skew 500 ppm
Aug 10 06:30:12 dist-test-slave-7lbf krb5kdc[23128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343412, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:12.183971 23307 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:12.185380 23307 webserver.cc:460] Webserver started at http://127.21.195.193:42093/ using document root <none> and password file <none>
I20260810 06:30:12.186244 23307 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:12.186331 23307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:12.186527 23307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:12.188809 23307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "2234a158f608434e8fd5b34468c28067"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "0c73f296d16542fcb2f8b54d22c39c9f"
server_key_iv: "348f9827403983c1487156dbbc843cc1"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.189404 23307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "2234a158f608434e8fd5b34468c28067"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "0c73f296d16542fcb2f8b54d22c39c9f"
server_key_iv: "348f9827403983c1487156dbbc843cc1"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.193730 23307 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:30:12.196501 23338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.198024 23307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:12.198163 23307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "2234a158f608434e8fd5b34468c28067"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "0c73f296d16542fcb2f8b54d22c39c9f"
server_key_iv: "348f9827403983c1487156dbbc843cc1"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.198292 23307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:12.230805 23307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:12.234361 23307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:12.234619 23307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:12.235320 23307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:12.236285 23307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:12.236339 23307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.236407 23307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:12.236436 23307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.245616 23307 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:36065
I20260810 06:30:12.245616 23523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:36065 every 8 connection(s)
I20260810 06:30:12.246665 23307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:12.253741 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23307
I20260810 06:30:12.253855 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:12.254113 22287 external_mini_cluster.cc:1428] Setting key 2659d8bcfb4f68d698d29f6708e9b6b5
Aug 10 06:30:12 dist-test-slave-7lbf krb5kdc[23128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343412, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:12.261418 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.248815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:40281 (local address 127.21.195.254:34767)
0810 06:30:12.248972 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:12.248976 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:12.249980 (+ 1004us) server_negotiation.cc:407] Connection header received
0810 06:30:12.251035 (+ 1055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:12.251038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:12.251100 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:12.251177 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:12.252652 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.253257 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.254626 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.254942 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.255045 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.257689 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:12.257693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:12.257696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:12.257724 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:12.259076 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:12.259646 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:12.259649 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:12.259650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:12.259760 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:12.260134 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:12.260137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:12.260139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:12.260357 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:12.260452 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:12.261069 (+ 617us) server_negotiation.cc:299] Negotiation successful
0810 06:30:12.261236 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:30:12.262354 23527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.249268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34767 (local address 127.21.195.193:40281)
0810 06:30:12.249803 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:12.249855 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:12.250805 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:12.251425 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:12.251437 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:12.251878 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:12.252484 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.252501 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.253402 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.253405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.254486 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.254498 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.255112 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.255116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.255305 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.255889 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:12.255908 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:12.257481 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:12.259201 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:12.259209 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:12.259228 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:12.259529 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:12.259851 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:12.259854 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:12.259856 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:12.260025 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:12.260469 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:12.260476 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:12.260795 (+ 319us) client_negotiation.cc:769] Sending connection context
0810 06:30:12.260983 (+ 188us) client_negotiation.cc:240] Negotiation successful
0810 06:30:12.261374 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":111,"threads_started":1}
I20260810 06:30:12.263780 23524 heartbeater.cc:347] Connected to a master server at 127.21.195.254:34767
I20260810 06:30:12.264111 23524 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:12.264830 23524 heartbeater.cc:511] Master 127.21.195.254:34767 requested a full tablet report, sending...
I20260810 06:30:12.266600 23201 ts_manager.cc:194] Registered new tserver with Master: 2234a158f608434e8fd5b34468c28067 (127.21.195.193:36065)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:12.267896 23201 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:40281
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:12.284359 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34767
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:12.408948 23531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:12.409279 23531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:12.409327 23531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:12.413682 23531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:12.413763 23531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:12.413836 23531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:12.419628 23531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34767
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:12.420917 23531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:12.422140 23531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:30:12.433041 23531 server_base.cc:1034] running on GCE node
W20260810 06:30:12.432982 23539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:12.433023 23538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:12.432982 23541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:12.433727 23531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:12.434473 23531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:12.435631 23531 hybrid_clock.cc:648] HybridClock initialized: now 1786343412435594 us; error 61 us; skew 500 ppm
Aug 10 06:30:12 dist-test-slave-7lbf krb5kdc[23128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343412, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:12.438673 23531 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:12.439807 23531 webserver.cc:460] Webserver started at http://127.21.195.194:34395/ using document root <none> and password file <none>
I20260810 06:30:12.440438 23531 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:12.440513 23531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:12.440739 23531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:12.443133 23531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "c3b73184246540b6976b0bbcb22b2320"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "e47e6c3aa431e376a2be9e7a2365f736"
server_key_iv: "03afdce21fb623dbaf5b855cdf83ec2a"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.443763 23531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "c3b73184246540b6976b0bbcb22b2320"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "e47e6c3aa431e376a2be9e7a2365f736"
server_key_iv: "03afdce21fb623dbaf5b855cdf83ec2a"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.448015 23531 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:12.450872 23549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.452435 23531 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:12.452579 23531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "c3b73184246540b6976b0bbcb22b2320"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "e47e6c3aa431e376a2be9e7a2365f736"
server_key_iv: "03afdce21fb623dbaf5b855cdf83ec2a"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.452694 23531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:12.466192 23531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:12.469903 23531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:12.470110 23531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:12.470836 23531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:12.471789 23531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:12.471840 23531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.471884 23531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:12.471915 23531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.481303 23531 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:39261
I20260810 06:30:12.481343 23723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:39261 every 8 connection(s)
I20260810 06:30:12.482419 23531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:12.482667 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23531
I20260810 06:30:12.482774 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:12.483103 22287 external_mini_cluster.cc:1428] Setting key ce5446108e1bc95c8894b450094fdd1c
Aug 10 06:30:12 dist-test-slave-7lbf krb5kdc[23128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343412, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:30:12.497339 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.484767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:60215 (local address 127.21.195.254:34767)
0810 06:30:12.484919 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:12.484924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:12.486046 (+ 1122us) server_negotiation.cc:407] Connection header received
0810 06:30:12.487270 (+ 1224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:12.487273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:12.487332 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:12.487424 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:12.488703 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.489242 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.490635 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.490879 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.490978 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.493584 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:12.493587 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:12.493589 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:12.493619 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:12.494993 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:12.495524 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:12.495528 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:12.495529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:12.495616 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:12.495967 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:12.495971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:12.495972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:12.496174 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:12.496266 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:12.497017 (+ 751us) server_negotiation.cc:299] Negotiation successful
0810 06:30:12.497171 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:30:12.498270 23726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.485214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34767 (local address 127.21.195.194:60215)
0810 06:30:12.485851 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:12.485926 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:12.486998 (+ 1072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:12.487600 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:12.487607 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:12.488001 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:12.488541 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.488556 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.489375 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.489379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.490488 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.490500 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.491038 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.491043 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.491237 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.491834 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:12.491852 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:12.493366 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:12.495113 (+ 1747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:12.495120 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:12.495141 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:12.495420 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:12.495704 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:12.495707 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:12.495710 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:12.495865 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:12.496280 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:12.496288 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:12.496662 (+ 374us) client_negotiation.cc:769] Sending connection context
0810 06:30:12.496899 (+ 237us) client_negotiation.cc:240] Negotiation successful
0810 06:30:12.497237 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":171,"threads_started":1}
I20260810 06:30:12.499622 23724 heartbeater.cc:347] Connected to a master server at 127.21.195.254:34767
I20260810 06:30:12.499904 23724 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:12.500490 23724 heartbeater.cc:511] Master 127.21.195.254:34767 requested a full tablet report, sending...
I20260810 06:30:12.501803 23201 ts_manager.cc:194] Registered new tserver with Master: c3b73184246540b6976b0bbcb22b2320 (127.21.195.194:39261)
I20260810 06:30:12.502593 23201 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:60215
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:12.513425 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34767
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:12.637225 23729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:12.637590 23729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:12.637676 23729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:12.641978 23729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:12.642052 23729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:12.642122 23729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:12.648020 23729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34767
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:12.649319 23729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:12.650589 23729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:12.661825 23740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:12.661834 23737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:12.661849 23735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:12.662155 23729 server_base.cc:1034] running on GCE node
I20260810 06:30:12.662765 23729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:12.663576 23729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:12.664791 23729 hybrid_clock.cc:648] HybridClock initialized: now 1786343412664755 us; error 40 us; skew 500 ppm
Aug 10 06:30:12 dist-test-slave-7lbf krb5kdc[23128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343412, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:12.667927 23729 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:12.669023 23729 webserver.cc:460] Webserver started at http://127.21.195.195:37993/ using document root <none> and password file <none>
I20260810 06:30:12.669723 23729 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:12.669807 23729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:12.670033 23729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:12.672503 23729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "439f1828ab1b4bb9960d78ae5944cddf"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "bfd2985dd671810b91702eee53095dca"
server_key_iv: "a77e7dfb0368fa3ae20970b90d88a356"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.673151 23729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "439f1828ab1b4bb9960d78ae5944cddf"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "bfd2985dd671810b91702eee53095dca"
server_key_iv: "a77e7dfb0368fa3ae20970b90d88a356"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.677500 23729 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 06:30:12.680330 23749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.681838 23729 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 06:30:12.681977 23729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "439f1828ab1b4bb9960d78ae5944cddf"
format_stamp: "Formatted at 2026-08-10 06:30:12 on dist-test-slave-7lbf"
server_key: "bfd2985dd671810b91702eee53095dca"
server_key_iv: "a77e7dfb0368fa3ae20970b90d88a356"
server_key_version: "encryptionkey@0"
I20260810 06:30:12.682092 23729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:12.708678 23729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:12.712219 23729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:12.712448 23729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:12.713158 23729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:12.714195 23729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:12.714251 23729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.714321 23729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:12.714351 23729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:12.723762 23729 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:41447
I20260810 06:30:12.723786 23946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:41447 every 8 connection(s)
I20260810 06:30:12.725001 23729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:12.732074 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23729
I20260810 06:30:12.732187 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:12.732437 22287 external_mini_cluster.cc:1428] Setting key 95f8b277fc5bab21bb5a04c4792377e0
Aug 10 06:30:12 dist-test-slave-7lbf krb5kdc[23128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343412, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:12.739185 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.727101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:55693 (local address 127.21.195.254:34767)
0810 06:30:12.727250 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:12.727254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:12.728234 (+ 980us) server_negotiation.cc:407] Connection header received
0810 06:30:12.729238 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:12.729242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:12.729307 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:12.729386 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:12.730792 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.731364 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.732680 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.732924 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.733023 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.735925 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:12.735928 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:12.735931 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:12.735961 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:12.737201 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:12.737761 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:12.737764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:12.737765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:12.737849 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:12.738164 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:12.738166 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:12.738167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:12.738361 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:12.738434 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:12.738934 (+ 500us) server_negotiation.cc:299] Negotiation successful
0810 06:30:12.739052 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:30:12.740175 23949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.727535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34767 (local address 127.21.195.195:55693)
0810 06:30:12.728053 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:12.728103 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:12.729004 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:12.729646 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:12.729655 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:12.730066 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:12.730629 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.730645 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.731505 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.731508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.732544 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.732556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.733080 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.733085 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.733265 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.733950 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:12.733977 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:12.735742 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:12.737305 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:12.737311 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:12.737328 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:12.737675 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:12.737935 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:12.737937 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:12.737939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:12.738094 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:12.738433 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:12.738438 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:12.738715 (+ 277us) client_negotiation.cc:769] Sending connection context
0810 06:30:12.738879 (+ 164us) client_negotiation.cc:240] Negotiation successful
0810 06:30:12.739192 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":132,"threads_started":1}
I20260810 06:30:12.741395 23947 heartbeater.cc:347] Connected to a master server at 127.21.195.254:34767
I20260810 06:30:12.741693 23947 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:12.742241 23947 heartbeater.cc:511] Master 127.21.195.254:34767 requested a full tablet report, sending...
I20260810 06:30:12.743413 23201 ts_manager.cc:194] Registered new tserver with Master: 439f1828ab1b4bb9960d78ae5944cddf (127.21.195.195:41447)
I20260810 06:30:12.744068 23201 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:55693
I20260810 06:30:12.747359 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:30:12.760010 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.752450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52374 (local address 127.21.195.254:34767)
0810 06:30:12.752603 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:12.752608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:12.752802 (+ 194us) server_negotiation.cc:407] Connection header received
0810 06:30:12.752914 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:12.752917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:12.752965 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:12.753035 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:12.753859 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.754420 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.755235 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.755471 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.755561 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.756879 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:12.756883 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:12.756886 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:12.756914 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:12.758362 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:12.758828 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:12.758831 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:12.758832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:12.758918 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:12.759136 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:12.759138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:12.759139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:12.759406 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:12.759515 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:12.759716 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 06:30:12.759835 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:30:12.766706 23201 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:12.770416 23201 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:12.789711 23975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.782994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56864 (local address 127.21.195.195:41447)
0810 06:30:12.783435 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:12.783447 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:12.783473 (+ 26us) server_negotiation.cc:407] Connection header received
0810 06:30:12.783552 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:12.783557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:12.783780 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:12.783964 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:12.784293 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.785576 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.787637 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.788561 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.788699 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.788979 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:12.789367 (+ 388us) server_negotiation.cc:299] Negotiation successful
0810 06:30:12.789492 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":107,"threads_started":1}
I20260810 06:30:12.789727 23966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.782090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:36065 (local address 127.0.0.1:47760)
0810 06:30:12.783530 (+ 1440us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:12.783544 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:12.783645 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:12.784307 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:12.784310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:12.784327 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:12.784412 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.784418 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.785579 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.785583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.788032 (+ 2449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.788044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.789337 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.789340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.789436 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.789456 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:30:12.789549 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 06:30:12.789614 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1365,"mutex_wait_us":60,"spinlock_wait_cycles":7168,"thread_start_us":141,"threads_started":1}
I20260810 06:30:12.789929 23969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.782325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:39261 (local address 127.0.0.1:41202)
0810 06:30:12.783532 (+ 1207us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:12.783544 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:12.783645 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:12.784159 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:12.784163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:12.784182 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:12.784284 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.784291 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.785758 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.785772 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.787121 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.787134 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.788771 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.788775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.788946 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.789026 (+ 80us) client_negotiation.cc:769] Sending connection context
0810 06:30:12.789184 (+ 158us) client_negotiation.cc:240] Negotiation successful
0810 06:30:12.789766 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1156,"mutex_wait_us":83,"spinlock_wait_cycles":1792,"thread_start_us":109,"threads_started":1}
I20260810 06:30:12.789727 23971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.782067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:41447 (local address 127.0.0.1:56864)
0810 06:30:12.783073 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:12.783133 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:12.783270 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:12.783953 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:12.783959 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:12.783981 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:12.784139 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.784146 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.785746 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.785750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.787474 (+ 1724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:12.787487 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.789059 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.789062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:12.789164 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.789189 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:30:12.789264 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 06:30:12.789463 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"mutex_wait_us":455,"thread_start_us":117,"threads_started":1}
I20260810 06:30:12.790645 23974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.782974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47760 (local address 127.21.195.193:36065)
0810 06:30:12.783390 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:12.783398 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:12.783642 (+ 244us) server_negotiation.cc:407] Connection header received
0810 06:30:12.783814 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:12.783819 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:12.784012 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:12.784181 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:12.784536 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.785405 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.788186 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.789007 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.789128 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.789272 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:12.790371 (+ 1099us) server_negotiation.cc:299] Negotiation successful
0810 06:30:12.790481 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":90,"threads_started":1}
I20260810 06:30:12.790704 23972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:12.782534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41202 (local address 127.21.195.194:39261)
0810 06:30:12.783476 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:12.783486 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:12.783695 (+ 209us) server_negotiation.cc:407] Connection header received
0810 06:30:12.783776 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:12.783781 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:12.783974 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:12.784126 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:12.784420 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.785630 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.787248 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:12.788597 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:12.790191 (+ 1594us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:12.790416 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:12.790463 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 06:30:12.790569 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":834,"thread_start_us":140,"threads_started":1}
I20260810 06:30:12.794119 23835 tablet_service.cc:1467] Processing CreateTablet for tablet a9c7a4a26c5544588056c6fd97835c70 (DEFAULT_TABLE table=test-table [id=af9f1ec0dd624252bd78b72bb7b9ac74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:12.795077 23627 tablet_service.cc:1467] Processing CreateTablet for tablet a9c7a4a26c5544588056c6fd97835c70 (DEFAULT_TABLE table=test-table [id=af9f1ec0dd624252bd78b72bb7b9ac74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:12.795671 23835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9c7a4a26c5544588056c6fd97835c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:12.795540 23414 tablet_service.cc:1467] Processing CreateTablet for tablet a9c7a4a26c5544588056c6fd97835c70 (DEFAULT_TABLE table=test-table [id=af9f1ec0dd624252bd78b72bb7b9ac74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:12.796273 23627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9c7a4a26c5544588056c6fd97835c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:12.796650 23414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a9c7a4a26c5544588056c6fd97835c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:12.803835 23976 tablet_bootstrap.cc:492] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320: Bootstrap starting.
I20260810 06:30:12.805382 23978 tablet_bootstrap.cc:492] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf: Bootstrap starting.
I20260810 06:30:12.807180 23976 tablet_bootstrap.cc:654] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:12.807500 23978 tablet_bootstrap.cc:654] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:12.808054 23976 log.cc:824] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:12.808900 23979 tablet_bootstrap.cc:492] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067: Bootstrap starting.
I20260810 06:30:12.808979 23978 log.cc:824] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:12.811059 23976 tablet_bootstrap.cc:492] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320: No bootstrap required, opened a new log
I20260810 06:30:12.811216 23978 tablet_bootstrap.cc:492] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf: No bootstrap required, opened a new log
I20260810 06:30:12.811270 23976 ts_tablet_manager.cc:1397] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 06:30:12.811440 23978 ts_tablet_manager.cc:1397] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:30:12.811450 23979 tablet_bootstrap.cc:654] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:12.812660 23979 log.cc:824] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:12.814960 23976 raft_consensus.cc:348] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:12.815231 23979 tablet_bootstrap.cc:492] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067: No bootstrap required, opened a new log
I20260810 06:30:12.815231 23976 raft_consensus.cc:374] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:12.815294 23976 raft_consensus.cc:729] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3b73184246540b6976b0bbcb22b2320, State: Initialized, Role: FOLLOWER
I20260810 06:30:12.815469 23979 ts_tablet_manager.cc:1397] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 06:30:12.815299 23978 raft_consensus.cc:348] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:12.815577 23978 raft_consensus.cc:374] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:12.815644 23978 raft_consensus.cc:729] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 439f1828ab1b4bb9960d78ae5944cddf, State: Initialized, Role: FOLLOWER
I20260810 06:30:12.815793 23976 consensus_queue.cc:260] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:12.816179 23978 consensus_queue.cc:260] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:12.816694 23724 heartbeater.cc:503] Master 127.21.195.254:34767 was elected leader, sending a full tablet report...
I20260810 06:30:12.816881 23976 ts_tablet_manager.cc:1428] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:30:12.817247 23978 ts_tablet_manager.cc:1428] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 06:30:12.817619 23947 heartbeater.cc:503] Master 127.21.195.254:34767 was elected leader, sending a full tablet report...
I20260810 06:30:12.821012 23979 raft_consensus.cc:348] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:12.821259 23979 raft_consensus.cc:374] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:12.821314 23979 raft_consensus.cc:729] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2234a158f608434e8fd5b34468c28067, State: Initialized, Role: FOLLOWER
I20260810 06:30:12.821864 23979 consensus_queue.cc:260] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:12.823001 23979 ts_tablet_manager.cc:1428] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260810 06:30:12.823211 23524 heartbeater.cc:503] Master 127.21.195.254:34767 was elected leader, sending a full tablet report...
W20260810 06:30:12.976291 23948 tablet.cc:2369] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:12.983960 23725 tablet.cc:2369] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:12.998167 23525 tablet.cc:2369] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:30:13.202833 23987 raft_consensus.cc:482] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:13.203145 23987 raft_consensus.cc:504] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:13.204535 23987 leader_election.cc:288] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 439f1828ab1b4bb9960d78ae5944cddf (127.21.195.195:41447), 2234a158f608434e8fd5b34468c28067 (127.21.195.193:36065)
I20260810 06:30:13.208837 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:13.204799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:41447 (local address 127.21.195.194:47633)
0810 06:30:13.205200 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:13.205213 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:13.205340 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:13.205622 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:13.205625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:13.205640 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:13.205940 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:13.205949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.206734 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.206738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:13.207708 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:13.207718 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.208406 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.208411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:13.208507 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:13.208536 (+ 29us) client_negotiation.cc:769] Sending connection context
0810 06:30:13.208606 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 06:30:13.208684 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"mutex_wait_us":70,"thread_start_us":94,"threads_started":1}
I20260810 06:30:13.208881 23975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:13.204930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:47633 (local address 127.21.195.195:41447)
0810 06:30:13.205070 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:13.205075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:13.205320 (+ 245us) server_negotiation.cc:407] Connection header received
0810 06:30:13.205443 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:13.205446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:13.205498 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:13.205600 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:13.206079 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.206607 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.207851 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.208262 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.208366 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:13.208411 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:13.208632 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 06:30:13.208712 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 06:30:13.209019 23993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:13.204841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:36065 (local address 127.21.195.194:46911)
0810 06:30:13.205331 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:13.205346 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:13.205470 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:13.205764 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:13.205766 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:13.205784 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:13.205897 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:13.205906 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.206740 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.206743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:13.207688 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:13.207698 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.208602 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.208606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:13.208709 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:13.208732 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 06:30:13.208808 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 06:30:13.208875 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":45,"thread_start_us":114,"threads_started":1}
I20260810 06:30:13.209048 23974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:13.204992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:46911 (local address 127.21.195.193:36065)
0810 06:30:13.205127 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:13.205132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:13.205458 (+ 326us) server_negotiation.cc:407] Connection header received
0810 06:30:13.205605 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:13.205609 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:13.205662 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:13.205739 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:13.206015 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.206621 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.207813 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.208477 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.208601 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:13.208648 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:13.208834 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 06:30:13.208934 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:13.209726 23863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9c7a4a26c5544588056c6fd97835c70" candidate_uuid: "c3b73184246540b6976b0bbcb22b2320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "439f1828ab1b4bb9960d78ae5944cddf" is_pre_election: true
I20260810 06:30:13.210216 23863 raft_consensus.cc:2454] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b73184246540b6976b0bbcb22b2320 in term 0.
I20260810 06:30:13.210902 23556 leader_election.cc:302] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 439f1828ab1b4bb9960d78ae5944cddf, c3b73184246540b6976b0bbcb22b2320; no voters:
I20260810 06:30:13.211193 23987 raft_consensus.cc:2781] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:13.211280 23987 raft_consensus.cc:482] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:13.211324 23987 raft_consensus.cc:3037] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:13.211508 23449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9c7a4a26c5544588056c6fd97835c70" candidate_uuid: "c3b73184246540b6976b0bbcb22b2320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234a158f608434e8fd5b34468c28067" is_pre_election: true
I20260810 06:30:13.211823 23449 raft_consensus.cc:2454] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3b73184246540b6976b0bbcb22b2320 in term 0.
I20260810 06:30:13.212596 23987 raft_consensus.cc:504] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:13.212954 23987 leader_election.cc:288] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [CANDIDATE]: Term 1 election: Requested vote from peers 439f1828ab1b4bb9960d78ae5944cddf (127.21.195.195:41447), 2234a158f608434e8fd5b34468c28067 (127.21.195.193:36065)
I20260810 06:30:13.213366 23449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9c7a4a26c5544588056c6fd97835c70" candidate_uuid: "c3b73184246540b6976b0bbcb22b2320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2234a158f608434e8fd5b34468c28067"
I20260810 06:30:13.213387 23863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a9c7a4a26c5544588056c6fd97835c70" candidate_uuid: "c3b73184246540b6976b0bbcb22b2320" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "439f1828ab1b4bb9960d78ae5944cddf"
I20260810 06:30:13.213532 23863 raft_consensus.cc:3037] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:13.213493 23449 raft_consensus.cc:3037] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:13.214653 23449 raft_consensus.cc:2454] T a9c7a4a26c5544588056c6fd97835c70 P 2234a158f608434e8fd5b34468c28067 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b73184246540b6976b0bbcb22b2320 in term 1.
I20260810 06:30:13.214783 23863 raft_consensus.cc:2454] T a9c7a4a26c5544588056c6fd97835c70 P 439f1828ab1b4bb9960d78ae5944cddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3b73184246540b6976b0bbcb22b2320 in term 1.
I20260810 06:30:13.215021 23552 leader_election.cc:302] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2234a158f608434e8fd5b34468c28067, c3b73184246540b6976b0bbcb22b2320; no voters:
I20260810 06:30:13.215201 23987 raft_consensus.cc:2781] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:13.215430 23987 raft_consensus.cc:686] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [term 1 LEADER]: Becoming Leader. State: Replica: c3b73184246540b6976b0bbcb22b2320, State: Running, Role: LEADER
I20260810 06:30:13.215801 23987 consensus_queue.cc:237] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } }
I20260810 06:30:13.219722 23201 catalog_manager.cc:5495] T a9c7a4a26c5544588056c6fd97835c70 P c3b73184246540b6976b0bbcb22b2320 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3b73184246540b6976b0bbcb22b2320 (127.21.195.194). New cstate: current_term: 1 leader_uuid: "c3b73184246540b6976b0bbcb22b2320" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "439f1828ab1b4bb9960d78ae5944cddf" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2234a158f608434e8fd5b34468c28067" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3b73184246540b6976b0bbcb22b2320" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 39261 } health_report { overall_health: HEALTHY } } }
Aug 10 06:30:13 dist-test-slave-7lbf krb5kdc[23128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343411, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:13.270460 23974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:13.255722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47770 (local address 127.21.195.193:36065)
0810 06:30:13.255841 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:13.255844 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:13.256226 (+ 382us) server_negotiation.cc:407] Connection header received
0810 06:30:13.256356 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:13.256358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:13.256409 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:13.256491 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:13.257251 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.257879 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.258846 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.259095 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.259185 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:13.266337 (+ 7152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:13.266358 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:13.266377 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:13.266418 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:13.268241 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:13.268843 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:13.268852 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:13.268854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:13.268975 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:13.269339 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:13.269342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:13.269343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:13.269716 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:13.269913 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:13.270146 (+ 233us) server_negotiation.cc:299] Negotiation successful
0810 06:30:13.270281 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 10 06:30:13 dist-test-slave-7lbf krb5kdc[23128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343413, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:30:13 dist-test-slave-7lbf krb5kdc[23128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343413, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:13.301997 23974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:13.292816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47778 (local address 127.21.195.193:36065)
0810 06:30:13.293007 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:13.293013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:13.293176 (+ 163us) server_negotiation.cc:407] Connection header received
0810 06:30:13.293331 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:13.293335 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:13.293392 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:13.293476 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:13.294296 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.294961 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.295841 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.296091 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.296190 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:13.298749 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:13.298753 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:13.298755 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:13.298787 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:13.300177 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:13.300614 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:13.300617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:13.300618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:13.300711 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:13.300990 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:13.300994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:13.300996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:13.301208 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:13.301338 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:13.301695 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 06:30:13.301821 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
Aug 10 06:30:13 dist-test-slave-7lbf krb5kdc[23128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:30:13 dist-test-slave-7lbf krb5kdc[23128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:13.331451 23974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:13.322490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47794 (local address 127.21.195.193:36065)
0810 06:30:13.322632 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:13.322637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:13.322807 (+ 170us) server_negotiation.cc:407] Connection header received
0810 06:30:13.322961 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:13.322964 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:13.323013 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:13.323091 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:13.323908 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.324426 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.325312 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:13.325604 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:13.325711 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:13.328284 (+ 2573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:13.328287 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:13.328289 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:13.328320 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:13.329734 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:13.330173 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:13.330176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:13.330178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:13.330268 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:13.330555 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:13.330559 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:13.330561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:13.330752 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:13.330876 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:13.331148 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 06:30:13.331279 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 06:30:13.333276 23382 tablet_service.cc:2908] Rejecting scan request for tablet a9c7a4a26c5544588056c6fd97835c70: Uninitialized: clean time has not yet been initialized
I20260810 06:30:13.335999 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23307
I20260810 06:30:13.348315 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23531
I20260810 06:30:13.364531 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23729
I20260810 06:30:13.385656 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23153
2026-08-10T06:30:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2955 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:13 dist-test-slave-7lbf krb5kdc[24023](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:13 dist-test-slave-7lbf krb5kdc[24023](info): set up 2 sockets
Aug 10 06:30:13 dist-test-slave-7lbf krb5kdc[24023](info): commencing operation
krb5kdc: starting...
W20260810 06:30:14.578395 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:14 dist-test-slave-7lbf krb5kdc[24023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343414, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:14.710804 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44413
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:44413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:14.837598 24041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:14.837929 24041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:14.837991 24041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:14.842213 24041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:14.842304 24041 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 06:30:14.842327 24041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:14.842351 24041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:14.842373 24041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:14.842394 24041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:14.848188 24041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:44413
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:14.849505 24041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:14.850907 24041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:14.860718 24053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:14.860718 24051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:14.860718 24049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:14.861132 24041 server_base.cc:1034] running on GCE node
I20260810 06:30:14.861881 24041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:14.863183 24041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:14.864367 24041 hybrid_clock.cc:648] HybridClock initialized: now 1786343414864340 us; error 38 us; skew 500 ppm
Aug 10 06:30:14 dist-test-slave-7lbf krb5kdc[24023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343414, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:14.867372 24041 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:14.868384 24041 webserver.cc:460] Webserver started at http://127.21.195.254:36325/ using document root <none> and password file <none>
I20260810 06:30:14.869010 24041 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:14.869083 24041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:14.869308 24041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:14.871634 24041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "b14d4a3b47aa40e1996f2e6112b85e4e"
format_stamp: "Formatted at 2026-08-10 06:30:14 on dist-test-slave-7lbf"
server_key: "6d8f68cb415d0de64eb34e2fc2933af7"
server_key_iv: "5bf08f158c52ad4b2c361c8de77b5fa6"
server_key_version: "encryptionkey@0"
I20260810 06:30:14.872241 24041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "b14d4a3b47aa40e1996f2e6112b85e4e"
format_stamp: "Formatted at 2026-08-10 06:30:14 on dist-test-slave-7lbf"
server_key: "6d8f68cb415d0de64eb34e2fc2933af7"
server_key_iv: "5bf08f158c52ad4b2c361c8de77b5fa6"
server_key_version: "encryptionkey@0"
I20260810 06:30:14.876387 24041 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:30:14.879114 24063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:14.880474 24041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:14.880606 24041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "b14d4a3b47aa40e1996f2e6112b85e4e"
format_stamp: "Formatted at 2026-08-10 06:30:14 on dist-test-slave-7lbf"
server_key: "6d8f68cb415d0de64eb34e2fc2933af7"
server_key_iv: "5bf08f158c52ad4b2c361c8de77b5fa6"
server_key_version: "encryptionkey@0"
I20260810 06:30:14.880719 24041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:14.908509 24041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:14.912199 24041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:14.912416 24041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:14.921921 24041 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:44413
I20260810 06:30:14.921958 24176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:44413 every 8 connection(s)
I20260810 06:30:14.923009 24041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:14.926270 24177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:14.929230 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24041
I20260810 06:30:14.929380 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:14.929718 22287 external_mini_cluster.cc:1428] Setting key 47a542e16b7727cc64996405e8b910dd
I20260810 06:30:14.933260 24177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e: Bootstrap starting.
I20260810 06:30:14.935756 24177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:14.936564 24177 log.cc:824] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:14.938711 24177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e: No bootstrap required, opened a new log
Aug 10 06:30:14 dist-test-slave-7lbf krb5kdc[24023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343414, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:14.942675 24177 raft_consensus.cc:348] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b14d4a3b47aa40e1996f2e6112b85e4e" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44413 } }
I20260810 06:30:14.942940 24177 raft_consensus.cc:374] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:14.942979 24177 raft_consensus.cc:729] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14d4a3b47aa40e1996f2e6112b85e4e, State: Initialized, Role: FOLLOWER
I20260810 06:30:14.943480 24177 consensus_queue.cc:260] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b14d4a3b47aa40e1996f2e6112b85e4e" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44413 } }
I20260810 06:30:14.943629 24177 raft_consensus.cc:388] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:14.943714 24177 raft_consensus.cc:482] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:14.943820 24177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:14.944804 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:14.931395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60122 (local address 127.21.195.254:44413)
0810 06:30:14.931949 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:14.931970 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:14.932011 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:30:14.932679 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:14.932699 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:14.933092 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:14.933447 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:14.934404 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:14.935454 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:14.936405 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:14.936950 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:14.937111 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:14.939857 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:14.939863 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:14.939880 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:14.939910 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:14.941644 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:14.942091 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:14.942098 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:14.942103 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:14.942227 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:14.942511 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:14.942514 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:14.942515 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:14.942995 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:14.943216 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:14.943492 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 06:30:14.943981 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":175,"threads_started":1}
I20260810 06:30:14.944798 24177 raft_consensus.cc:504] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b14d4a3b47aa40e1996f2e6112b85e4e" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44413 } }
I20260810 06:30:14.945187 24177 leader_election.cc:302] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b14d4a3b47aa40e1996f2e6112b85e4e; no voters:
I20260810 06:30:14.945537 24177 leader_election.cc:288] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:14.945638 24182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:14.945937 24182 raft_consensus.cc:686] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [term 1 LEADER]: Becoming Leader. State: Replica: b14d4a3b47aa40e1996f2e6112b85e4e, State: Running, Role: LEADER
I20260810 06:30:14.946326 24182 consensus_queue.cc:237] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b14d4a3b47aa40e1996f2e6112b85e4e" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44413 } }
I20260810 06:30:14.947660 24182 sys_catalog.cc:455] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b14d4a3b47aa40e1996f2e6112b85e4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b14d4a3b47aa40e1996f2e6112b85e4e" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44413 } } }
I20260810 06:30:14.947815 24183 sys_catalog.cc:455] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b14d4a3b47aa40e1996f2e6112b85e4e. Latest consensus state: current_term: 1 leader_uuid: "b14d4a3b47aa40e1996f2e6112b85e4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b14d4a3b47aa40e1996f2e6112b85e4e" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44413 } } }
I20260810 06:30:14.947944 24183 sys_catalog.cc:458] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:14.947872 24182 sys_catalog.cc:458] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:14.948406 24177 sys_catalog.cc:564] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:14.948554 24191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:14.951998 24191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:14.958449 24191 catalog_manager.cc:1347] Generated new cluster ID: 8db923dc4e6544ef86315226aa303d26
I20260810 06:30:14.958536 24191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:14.988227 24191 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:14.989609 24191 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:14.998910 24191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e: Generated new TSK 0
I20260810 06:30:14.999693 24191 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:15.036334 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44413
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:15.162714 24216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:15.163045 24216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:15.163096 24216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:15.167418 24216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:15.167510 24216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:15.167557 24216 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:15.167593 24216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:15.173302 24216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:44413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:15.174572 24216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:15.175711 24216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:15.186718 24223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:15.186872 24216 server_base.cc:1034] running on GCE node
W20260810 06:30:15.186720 24227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:15.186720 24225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:15.187538 24216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:15.188277 24216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:15.189456 24216 hybrid_clock.cc:648] HybridClock initialized: now 1786343415189431 us; error 37 us; skew 500 ppm
Aug 10 06:30:15 dist-test-slave-7lbf krb5kdc[24023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:15.192610 24216 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:15.193871 24216 webserver.cc:460] Webserver started at http://127.21.195.193:32829/ using document root <none> and password file <none>
I20260810 06:30:15.194471 24216 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:15.194538 24216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:15.194741 24216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:15.197018 24216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "e4cc7a023b3b4ebead1694873a09b304"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "0e1612be6beecfba6d756a03a1f90cbd"
server_key_iv: "184dd6bfd2e5dfbefbe1c3d7ff087bff"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.197698 24216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "e4cc7a023b3b4ebead1694873a09b304"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "0e1612be6beecfba6d756a03a1f90cbd"
server_key_iv: "184dd6bfd2e5dfbefbe1c3d7ff087bff"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.202314 24216 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:15.205104 24236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:15.206602 24216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:15.206746 24216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "e4cc7a023b3b4ebead1694873a09b304"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "0e1612be6beecfba6d756a03a1f90cbd"
server_key_iv: "184dd6bfd2e5dfbefbe1c3d7ff087bff"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.206876 24216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:15.235925 24216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:15.239701 24216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:15.239926 24216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:15.241699 24216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:15.241758 24216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:15.241803 24216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:15.241842 24216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:30:15 dist-test-slave-7lbf krb5kdc[24023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:15.253643 24216 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:40887
I20260810 06:30:15.253680 24413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:40887 every 8 connection(s)
I20260810 06:30:15.254798 24216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:15.255056 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24216
I20260810 06:30:15.255152 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:15.255460 22287 external_mini_cluster.cc:1428] Setting key 243c389441c4e590475f40298bd32697
I20260810 06:30:15.257395 24251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.243100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44413 (local address 127.21.195.193:34369)
0810 06:30:15.243658 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.243727 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.244886 (+ 1159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.245625 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.245633 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.246018 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:15.246547 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.246563 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.247398 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.247403 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.248480 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.248492 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.249099 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.249104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.249317 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.250035 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:15.250054 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:15.251836 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:15.253928 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.253933 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.253948 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.254218 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.254582 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.254585 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.254586 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.254756 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.255338 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:15.255345 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:15.255688 (+ 343us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.255905 (+ 217us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.256291 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":126,"threads_started":1}
I20260810 06:30:15.258081 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.242656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:34369 (local address 127.21.195.254:44413)
0810 06:30:15.242825 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.242831 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.243864 (+ 1033us) server_negotiation.cc:407] Connection header received
0810 06:30:15.245178 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.245182 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.245250 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.245365 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:15.246713 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.247260 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.248614 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.248866 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.248966 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.252039 (+ 3073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:15.252044 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:15.252047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:15.252084 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:15.253803 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.254333 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.254337 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.254338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.254445 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.254886 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.254890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.254892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.255151 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:15.255261 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.257825 (+ 2564us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.257963 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 06:30:15.260072 24414 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44413
I20260810 06:30:15.260352 24414 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:15.261016 24414 heartbeater.cc:511] Master 127.21.195.254:44413 requested a full tablet report, sending...
I20260810 06:30:15.263494 24091 ts_manager.cc:194] Registered new tserver with Master: e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887)
I20260810 06:30:15.264714 24091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:34369
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:15.273881 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.265395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:33635 (local address 127.21.195.254:44413)
0810 06:30:15.265506 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.265509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.265539 (+ 30us) server_negotiation.cc:407] Connection header received
0810 06:30:15.265581 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.265583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.265619 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.265696 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:15.267708 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.268223 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.269093 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.269320 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.269422 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.270612 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:15.270617 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:15.270620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:15.270650 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:15.272168 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.272608 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.272611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.272613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.272697 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.272999 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.273003 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.273005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.273199 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:15.273289 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.273589 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.273713 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:30:15.273902 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.262831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44413 (local address 127.21.195.193:33635)
0810 06:30:15.263156 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.263172 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.263266 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.267263 (+ 3997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.267265 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.267456 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:15.267564 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.267571 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.268362 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.268365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.268973 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.268984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.269443 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.269447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.269567 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.270075 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:15.270087 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:15.270443 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:15.272308 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.272311 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.272312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.272522 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.272795 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.272798 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.272801 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.272908 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.273295 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:15.273298 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:15.273396 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.273488 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.273693 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:15.285789 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44413
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:15.409732 24426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:15.410091 24426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:15.410163 24426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:15.414675 24426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:15.414765 24426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:15.414824 24426 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:15.414886 24426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:15.420758 24426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:44413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:15.422115 24426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:15.423413 24426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:15.434369 24442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:15.434340 24433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:15.434337 24438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:15.434557 24426 server_base.cc:1034] running on GCE node
I20260810 06:30:15.436682 24426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:15.437450 24426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:15.438687 24426 hybrid_clock.cc:648] HybridClock initialized: now 1786343415438645 us; error 56 us; skew 500 ppm
Aug 10 06:30:15 dist-test-slave-7lbf krb5kdc[24023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:15.441847 24426 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:15.442850 24426 webserver.cc:460] Webserver started at http://127.21.195.194:36591/ using document root <none> and password file <none>
I20260810 06:30:15.443470 24426 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:15.443539 24426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:15.443737 24426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:15.446156 24426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "29cbc59664a4430482375ad4bff0b6a4"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "9295f34de62812613ff4d49ae6ccc3b9"
server_key_iv: "586187d9a7846eb582abfe837dba9037"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.446782 24426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "29cbc59664a4430482375ad4bff0b6a4"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "9295f34de62812613ff4d49ae6ccc3b9"
server_key_iv: "586187d9a7846eb582abfe837dba9037"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.451393 24426 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:15.454399 24455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:15.456000 24426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:15.456122 24426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "29cbc59664a4430482375ad4bff0b6a4"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "9295f34de62812613ff4d49ae6ccc3b9"
server_key_iv: "586187d9a7846eb582abfe837dba9037"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.456231 24426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:15.479473 24426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:15.483192 24426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:15.483438 24426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:15.485352 24426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:15.485414 24426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:15.485457 24426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:15.485477 24426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:15.496356 24426 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:41747
I20260810 06:30:15.496403 24633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:41747 every 8 connection(s)
Aug 10 06:30:15 dist-test-slave-7lbf krb5kdc[24023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:15.497612 24426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:15.501291 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.486244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:44649 (local address 127.21.195.254:44413)
0810 06:30:15.486444 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.486449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.487427 (+ 978us) server_negotiation.cc:407] Connection header received
0810 06:30:15.488658 (+ 1231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.488663 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.488731 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.488840 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:15.490858 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.491724 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.493643 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.493980 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.494129 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.497370 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:15.497373 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:15.497375 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:15.497412 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:15.499052 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.499631 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.499635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.499637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.499736 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.500099 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.500102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.500104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.500340 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:15.500433 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.500982 (+ 549us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.501122 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:15.502206 24469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.486750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44413 (local address 127.21.195.194:44649)
0810 06:30:15.487250 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.487306 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.488391 (+ 1085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.489211 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.489222 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.489817 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:15.490645 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.490673 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.491878 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.491882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.493449 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.493463 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.494163 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.494168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.494434 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.495183 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:15.495205 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:15.497160 (+ 1955us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:15.499198 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.499204 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.499218 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.499502 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.499828 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.499831 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.499833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.499994 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.500444 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:15.500451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:15.500728 (+ 277us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.500914 (+ 186us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.501267 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":119,"threads_started":1}
I20260810 06:30:15.503473 24635 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44413
I20260810 06:30:15.503628 24635 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:15.504158 24635 heartbeater.cc:511] Master 127.21.195.254:44413 requested a full tablet report, sending...
I20260810 06:30:15.504554 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24426
I20260810 06:30:15.504673 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:15.504988 22287 external_mini_cluster.cc:1428] Setting key b8bfd967cc02384b15defeb0cce6e993
I20260810 06:30:15.505271 24091 ts_manager.cc:194] Registered new tserver with Master: 29cbc59664a4430482375ad4bff0b6a4 (127.21.195.194:41747)
I20260810 06:30:15.506060 24091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:44649
I20260810 06:30:15.514107 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.505958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44413 (local address 127.21.195.194:39843)
0810 06:30:15.506454 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.506470 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.506579 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.506875 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.506886 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.507127 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:15.507284 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.507292 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.508294 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.508298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.508942 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.508952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.509489 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.509491 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.509614 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.510147 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:15.510161 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:15.510612 (+ 451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:15.512482 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.512485 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.512487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.512690 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.512972 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.512974 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.512976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.513048 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.513615 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:15.513618 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:15.513721 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.513814 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.513951 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":1,"thread_start_us":104,"threads_started":1}
I20260810 06:30:15.514184 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.506168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:39843 (local address 127.21.195.254:44413)
0810 06:30:15.506278 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.506282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.506546 (+ 264us) server_negotiation.cc:407] Connection header received
0810 06:30:15.506704 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.506708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.506757 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.506840 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:15.507411 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.508149 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.509060 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.509385 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.509492 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.510764 (+ 1272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:15.510768 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:15.510770 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:15.510794 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:15.512360 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.512781 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.512784 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.512786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.512888 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.513122 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.513125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.513127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.513454 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:15.513616 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.513892 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.514022 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:15.534440 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44413
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:46365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:15.658741 24646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:15.659086 24646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:15.659137 24646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:15.663483 24646 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:15.663568 24646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:15.663609 24646 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:15.663642 24646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:15.669339 24646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:44413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:15.670653 24646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:15.671787 24646 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:15.682682 24656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:15.682760 24646 server_base.cc:1034] running on GCE node
W20260810 06:30:15.682722 24657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:15.682714 24661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:15.683435 24646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:15.684181 24646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:15.685352 24646 hybrid_clock.cc:648] HybridClock initialized: now 1786343415685307 us; error 60 us; skew 500 ppm
Aug 10 06:30:15 dist-test-slave-7lbf krb5kdc[24023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:15.688443 24646 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:15.689467 24646 webserver.cc:460] Webserver started at http://127.21.195.195:37305/ using document root <none> and password file <none>
I20260810 06:30:15.690115 24646 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:15.690192 24646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:15.690452 24646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:15.692795 24646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "0f3a7d5647ef485f813d478453b162fc"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "c331573a9077ecf288bb914ca093d2fe"
server_key_iv: "164b70dcacbe5bf41f471fe4fc3ac8f9"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.693418 24646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "0f3a7d5647ef485f813d478453b162fc"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "c331573a9077ecf288bb914ca093d2fe"
server_key_iv: "164b70dcacbe5bf41f471fe4fc3ac8f9"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.697795 24646 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:15.700662 24668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:15.702099 24646 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:15.702227 24646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "0f3a7d5647ef485f813d478453b162fc"
format_stamp: "Formatted at 2026-08-10 06:30:15 on dist-test-slave-7lbf"
server_key: "c331573a9077ecf288bb914ca093d2fe"
server_key_iv: "164b70dcacbe5bf41f471fe4fc3ac8f9"
server_key_version: "encryptionkey@0"
I20260810 06:30:15.702344 24646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:15.719549 24646 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:15.723232 24646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:15.723453 24646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:15.725157 24646 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:15.725214 24646 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:15.725272 24646 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:15.725301 24646 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:15.736145 24646 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:36735
I20260810 06:30:15.736163 24852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:36735 every 8 connection(s)
Aug 10 06:30:15 dist-test-slave-7lbf krb5kdc[24023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:15.737226 24646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:15.740582 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.726214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:39925 (local address 127.21.195.254:44413)
0810 06:30:15.726378 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.726383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.727402 (+ 1019us) server_negotiation.cc:407] Connection header received
0810 06:30:15.728643 (+ 1241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.728647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.728712 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.728804 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:15.730768 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.731603 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.733483 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.733764 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.733883 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.737094 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:15.737097 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:15.737099 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:15.737128 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:15.738716 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.739206 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.739208 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.739210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.739289 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.739575 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.739577 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.739578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.739777 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:15.739853 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.740332 (+ 479us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.740449 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 06:30:15.741643 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.726673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44413 (local address 127.21.195.195:39925)
0810 06:30:15.727223 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.727281 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.728404 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.729078 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.729089 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.729682 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:15.730491 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.730536 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.731755 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.731759 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.733322 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.733336 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.733964 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.733969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.734212 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.734996 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:15.735018 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:15.736873 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:15.738825 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.738830 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.738842 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.739118 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.739357 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.739359 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.739361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.739507 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.739852 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:15.739858 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:15.740125 (+ 267us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.740292 (+ 167us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.740599 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":143,"threads_started":1}
I20260810 06:30:15.742820 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24646
I20260810 06:30:15.742954 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:15.743057 24853 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44413
I20260810 06:30:15.743213 24853 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:15.743258 22287 external_mini_cluster.cc:1428] Setting key e91b7d10ba5dc6d8a291bb668ab9f8d4
I20260810 06:30:15.743862 24853 heartbeater.cc:511] Master 127.21.195.254:44413 requested a full tablet report, sending...
I20260810 06:30:15.744992 24091 ts_manager.cc:194] Registered new tserver with Master: 0f3a7d5647ef485f813d478453b162fc (127.21.195.195:36735)
I20260810 06:30:15.745780 24091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:39925
I20260810 06:30:15.752590 24861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.745383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44413 (local address 127.21.195.195:51821)
0810 06:30:15.745705 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.745717 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.745811 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.746080 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.746083 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.746295 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:15.746407 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.746413 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.747164 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.747167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.747737 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.747746 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.748227 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.748231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.748324 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.748847 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:15.748861 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:15.749297 (+ 436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:15.751064 (+ 1767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.751068 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.751070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.751275 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.751543 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:15.751547 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:15.751549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:15.751638 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:15.752023 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:15.752027 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:15.752126 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.752215 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.752397 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":139,"threads_started":1}
I20260810 06:30:15.752579 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.745460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:51821 (local address 127.21.195.254:44413)
0810 06:30:15.745609 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.745613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.745783 (+ 170us) server_negotiation.cc:407] Connection header received
0810 06:30:15.745927 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.745930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.745976 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.746058 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:15.746518 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.747038 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.747851 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.748082 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.748172 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.749452 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:15.749456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:15.749459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:15.749486 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:15.750958 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.751366 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.751370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.751372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.751458 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.751719 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.751723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.751725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.751929 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:15.752020 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.752284 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.752404 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 06:30:15.757470 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 06:30:15 dist-test-slave-7lbf krb5kdc[24023](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:30:15 dist-test-slave-7lbf krb5kdc[24023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:15.786010 24180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.777612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60128 (local address 127.21.195.254:44413)
0810 06:30:15.777751 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.777755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.777767 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:30:15.777811 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.777813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.777855 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.777928 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:15.778709 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.779252 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.780125 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.780350 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.780448 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.783017 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:15.783021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:15.783023 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:15.783056 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:15.784354 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.784756 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.784758 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.784759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.784837 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:15.785103 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:15.785106 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:15.785107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:15.785321 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:15.785433 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.785755 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.785868 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:30:15.789048 24091 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:15.792352 24091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:15.808467 24880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.802781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:41747 (local address 127.0.0.1:60578)
0810 06:30:15.803407 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.803421 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.803513 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.804196 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.804199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.804217 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:15.804316 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.804323 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.805685 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.805688 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.806739 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.806749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.807945 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.807949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.808066 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.808110 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.808198 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.808302 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":21,"thread_start_us":105,"threads_started":1}
I20260810 06:30:15.808509 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.803389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60578 (local address 127.21.195.194:41747)
0810 06:30:15.803745 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.803754 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.803773 (+ 19us) server_negotiation.cc:407] Connection header received
0810 06:30:15.803835 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.803839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.803998 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.804229 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:15.804414 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.805574 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.806861 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.807805 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.808074 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.808189 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.808242 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.808341 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":121,"threads_started":1}
I20260810 06:30:15.808611 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.802160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:36735 (local address 127.0.0.1:53770)
0810 06:30:15.803251 (+ 1091us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.803264 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.803339 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.804264 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.804266 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.804281 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:15.804356 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.804362 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.805354 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.805358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.806870 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.806881 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.808165 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.808169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.808262 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.808284 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.808359 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.808429 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1028,"thread_start_us":98,"threads_started":1}
I20260810 06:30:15.808660 24881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.802790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.21.195.195:36735)
0810 06:30:15.803633 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.803644 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.803669 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:30:15.803748 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.803752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.803937 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.804104 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:15.804479 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.805225 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.807005 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.807804 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.807946 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.808102 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.808423 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.808528 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":736,"thread_start_us":117,"threads_started":1}
I20260810 06:30:15.811724 24750 tablet_service.cc:1467] Processing CreateTablet for tablet 7b9922674e2f48b7b44ef19b0dde4bbf (DEFAULT_TABLE table=test-table [id=912d137c1dd64d36ad3ea1f32a31c779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:15.811723 24536 tablet_service.cc:1467] Processing CreateTablet for tablet 7b9922674e2f48b7b44ef19b0dde4bbf (DEFAULT_TABLE table=test-table [id=912d137c1dd64d36ad3ea1f32a31c779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:15.812785 24750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b9922674e2f48b7b44ef19b0dde4bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:15.812770 24536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b9922674e2f48b7b44ef19b0dde4bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:15.816808 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.802085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45136 (local address 127.21.195.193:40887)
0810 06:30:15.802414 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:15.802422 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:15.802827 (+ 405us) server_negotiation.cc:407] Connection header received
0810 06:30:15.803168 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:15.803175 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:15.803421 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:15.803554 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:15.804103 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.805364 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.807086 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.807786 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.807905 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.808066 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:15.809459 (+ 1393us) server_negotiation.cc:299] Negotiation successful
0810 06:30:15.816662 (+ 7203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":103,"threads_started":1}
I20260810 06:30:15.817199 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:15.801886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:40887 (local address 127.0.0.1:45136)
0810 06:30:15.802674 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:15.802733 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:15.802967 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:15.803770 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:15.803776 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:15.803799 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:15.803964 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.803972 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.805579 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.805582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.806974 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:15.806982 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:15.807903 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:15.807907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:15.809287 (+ 1380us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:15.809311 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 06:30:15.816971 (+ 7660us) client_negotiation.cc:240] Negotiation successful
0810 06:30:15.817087 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"mutex_wait_us":56,"thread_start_us":105,"threads_started":1}
I20260810 06:30:15.820645 24883 tablet_bootstrap.cc:492] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Bootstrap starting.
I20260810 06:30:15.820657 24319 tablet_service.cc:1467] Processing CreateTablet for tablet 7b9922674e2f48b7b44ef19b0dde4bbf (DEFAULT_TABLE table=test-table [id=912d137c1dd64d36ad3ea1f32a31c779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:15.821959 24319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b9922674e2f48b7b44ef19b0dde4bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:15.822851 24886 tablet_bootstrap.cc:492] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Bootstrap starting.
I20260810 06:30:15.824532 24883 tablet_bootstrap.cc:654] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:15.825270 24886 tablet_bootstrap.cc:654] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:15.825549 24883 log.cc:824] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:15.826193 24886 log.cc:824] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:15.827831 24883 tablet_bootstrap.cc:492] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: No bootstrap required, opened a new log
I20260810 06:30:15.828078 24883 ts_tablet_manager.cc:1397] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260810 06:30:15.828315 24886 tablet_bootstrap.cc:492] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: No bootstrap required, opened a new log
I20260810 06:30:15.828524 24886 ts_tablet_manager.cc:1397] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260810 06:30:15.829202 24890 tablet_bootstrap.cc:492] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Bootstrap starting.
I20260810 06:30:15.831796 24890 tablet_bootstrap.cc:654] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:15.832558 24890 log.cc:824] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:15.832528 24883 raft_consensus.cc:348] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:15.832844 24883 raft_consensus.cc:374] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:15.832710 24886 raft_consensus.cc:348] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:15.832906 24883 raft_consensus.cc:729] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cbc59664a4430482375ad4bff0b6a4, State: Initialized, Role: FOLLOWER
I20260810 06:30:15.832962 24886 raft_consensus.cc:374] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:15.833015 24886 raft_consensus.cc:729] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3a7d5647ef485f813d478453b162fc, State: Initialized, Role: FOLLOWER
I20260810 06:30:15.833432 24883 consensus_queue.cc:260] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:15.833434 24886 consensus_queue.cc:260] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:15.834551 24886 ts_tablet_manager.cc:1428] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 06:30:15.834551 24883 ts_tablet_manager.cc:1428] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 06:30:15.834973 24853 heartbeater.cc:503] Master 127.21.195.254:44413 was elected leader, sending a full tablet report...
I20260810 06:30:15.835160 24635 heartbeater.cc:503] Master 127.21.195.254:44413 was elected leader, sending a full tablet report...
I20260810 06:30:15.835253 24890 tablet_bootstrap.cc:492] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: No bootstrap required, opened a new log
I20260810 06:30:15.835453 24890 ts_tablet_manager.cc:1397] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:30:15.840255 24890 raft_consensus.cc:348] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:15.840545 24890 raft_consensus.cc:374] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:15.840595 24890 raft_consensus.cc:729] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cc7a023b3b4ebead1694873a09b304, State: Initialized, Role: FOLLOWER
I20260810 06:30:15.841037 24890 consensus_queue.cc:260] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:15.841792 24414 heartbeater.cc:503] Master 127.21.195.254:44413 was elected leader, sending a full tablet report...
I20260810 06:30:15.842118 24890 ts_tablet_manager.cc:1428] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
W20260810 06:30:15.988710 24855 tablet.cc:2369] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:16.000092 24636 tablet.cc:2369] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:16.006623 24415 tablet.cc:2369] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:30:16.039242 24892 raft_consensus.cc:482] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:16.039474 24892 raft_consensus.cc:504] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:16.040678 24892 leader_election.cc:288] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887), 29cbc59664a4430482375ad4bff0b6a4 (127.21.195.194:41747)
I20260810 06:30:16.044796 24683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.041050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:40887 (local address 127.21.195.195:54141)
0810 06:30:16.041185 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:16.041203 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:16.041322 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:16.041680 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:16.041683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:16.041707 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:16.041836 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.041844 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.042647 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.042651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.043708 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.043718 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.044401 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.044406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.044516 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.044542 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 06:30:16.044611 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 06:30:16.044678 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 06:30:16.044869 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.041154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:54141 (local address 127.21.195.193:40887)
0810 06:30:16.041331 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.041336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.041356 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:30:16.041422 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.041426 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.041478 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.041600 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:16.041951 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.042534 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.043822 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.044303 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.044400 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.044448 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.044632 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.044716 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 06:30:16.045619 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b9922674e2f48b7b44ef19b0dde4bbf" candidate_uuid: "0f3a7d5647ef485f813d478453b162fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cc7a023b3b4ebead1694873a09b304" is_pre_election: true
I20260810 06:30:16.045764 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.041466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:33897 (local address 127.21.195.194:41747)
0810 06:30:16.041614 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.041618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.041864 (+ 246us) server_negotiation.cc:407] Connection header received
0810 06:30:16.041950 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.041953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.042004 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.042081 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:16.042895 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.043463 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.044630 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.045182 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.045299 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.045340 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.045595 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.045662 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 06:30:16.045804 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.041336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:41747 (local address 127.21.195.195:33897)
0810 06:30:16.041754 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:16.041767 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:16.041865 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:16.042091 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:16.042093 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:16.042106 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:16.042759 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.042768 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.043572 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.043576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.044492 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.044501 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.045324 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.045328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.045433 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.045458 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:30:16.045581 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:30:16.045664 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":145,"threads_started":1}
I20260810 06:30:16.046043 24351 raft_consensus.cc:2454] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3a7d5647ef485f813d478453b162fc in term 0.
I20260810 06:30:16.046559 24674 leader_election.cc:302] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3a7d5647ef485f813d478453b162fc, e4cc7a023b3b4ebead1694873a09b304; no voters:
I20260810 06:30:16.046849 24892 raft_consensus.cc:2781] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:16.046823 24561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b9922674e2f48b7b44ef19b0dde4bbf" candidate_uuid: "0f3a7d5647ef485f813d478453b162fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cbc59664a4430482375ad4bff0b6a4" is_pre_election: true
I20260810 06:30:16.046959 24892 raft_consensus.cc:482] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:16.047008 24892 raft_consensus.cc:3037] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.047194 24561 raft_consensus.cc:2454] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3a7d5647ef485f813d478453b162fc in term 0.
I20260810 06:30:16.048241 24892 raft_consensus.cc:504] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:16.048574 24892 leader_election.cc:288] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [CANDIDATE]: Term 1 election: Requested vote from peers e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887), 29cbc59664a4430482375ad4bff0b6a4 (127.21.195.194:41747)
I20260810 06:30:16.048928 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b9922674e2f48b7b44ef19b0dde4bbf" candidate_uuid: "0f3a7d5647ef485f813d478453b162fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cc7a023b3b4ebead1694873a09b304"
I20260810 06:30:16.049060 24561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b9922674e2f48b7b44ef19b0dde4bbf" candidate_uuid: "0f3a7d5647ef485f813d478453b162fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cbc59664a4430482375ad4bff0b6a4"
I20260810 06:30:16.049083 24351 raft_consensus.cc:3037] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.049197 24561 raft_consensus.cc:3037] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.050300 24351 raft_consensus.cc:2454] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3a7d5647ef485f813d478453b162fc in term 1.
I20260810 06:30:16.050319 24561 raft_consensus.cc:2454] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3a7d5647ef485f813d478453b162fc in term 1.
I20260810 06:30:16.050647 24674 leader_election.cc:302] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3a7d5647ef485f813d478453b162fc, e4cc7a023b3b4ebead1694873a09b304; no voters:
I20260810 06:30:16.050817 24892 raft_consensus.cc:2781] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:16.051030 24892 raft_consensus.cc:686] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 1 LEADER]: Becoming Leader. State: Replica: 0f3a7d5647ef485f813d478453b162fc, State: Running, Role: LEADER
I20260810 06:30:16.051594 24892 consensus_queue.cc:237] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } }
I20260810 06:30:16.055282 24091 catalog_manager.cc:5495] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3a7d5647ef485f813d478453b162fc (127.21.195.195). New cstate: current_term: 1 leader_uuid: "0f3a7d5647ef485f813d478453b162fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } health_report { overall_health: UNKNOWN } } }
I20260810 06:30:16.111689 24881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.107640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53772 (local address 127.21.195.195:36735)
0810 06:30:16.107762 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.107766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.107821 (+ 55us) server_negotiation.cc:407] Connection header received
0810 06:30:16.108050 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.108053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.108113 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.108212 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:16.108442 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.108963 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.109941 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.110207 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.110310 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.110647 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:16.111257 (+ 610us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:16.111356 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.111493 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.111559 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:30:16.119107 24351 raft_consensus.cc:1261] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Refusing update from remote peer 0f3a7d5647ef485f813d478453b162fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:16.120033 24561 raft_consensus.cc:1261] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Refusing update from remote peer 0f3a7d5647ef485f813d478453b162fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:16.120010 24892 consensus_queue.cc:1035] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:16.120741 24892 consensus_queue.cc:1035] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:16.128958 24908 mvcc.cc:205] Tried to move back new op lower bound from 7316862632413646848 to 7316862632150122496. Current Snapshot: MvccSnapshot[applied={T|T < 7316862632413646848}]
I20260810 06:30:16.131960 24905 mvcc.cc:205] Tried to move back new op lower bound from 7316862632413646848 to 7316862632150122496. Current Snapshot: MvccSnapshot[applied={T|T < 7316862632413646848}]
I20260810 06:30:16.143903 24093 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:16.144235 24093 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:16.147509 24093 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e: Sending DeleteTablet for 3 replicas of tablet 7b9922674e2f48b7b44ef19b0dde4bbf
I20260810 06:30:16.148599 24536 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b9922674e2f48b7b44ef19b0dde4bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:16 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:60578
I20260810 06:30:16.148602 24750 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b9922674e2f48b7b44ef19b0dde4bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:16 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:53770
I20260810 06:30:16.148672 24319 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b9922674e2f48b7b44ef19b0dde4bbf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:16 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:45136
I20260810 06:30:16.149245 24919 tablet_replica.cc:330] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: stopping tablet replica
I20260810 06:30:16.149690 24919 raft_consensus.cc:2229] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:16.150072 24919 raft_consensus.cc:2258] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:16.150313 24920 tablet_replica.cc:330] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: stopping tablet replica
I20260810 06:30:16.150586 24093 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 06:30:16.150728 24920 raft_consensus.cc:2229] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:16.151093 24920 raft_consensus.cc:2258] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 06:30:16.151108 24093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:16.151568 24921 tablet_replica.cc:330] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: stopping tablet replica
I20260810 06:30:16.151921 24921 raft_consensus.cc:2229] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:16.152083 24919 ts_tablet_manager.cc:1905] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:16.152375 24921 raft_consensus.cc:2258] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:16.154114 24920 ts_tablet_manager.cc:1905] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:16.155627 24919 ts_tablet_manager.cc:1918] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:16.155758 24919 log.cc:1196] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/7b9922674e2f48b7b44ef19b0dde4bbf
I20260810 06:30:16.156221 24919 ts_tablet_manager.cc:1939] T 7b9922674e2f48b7b44ef19b0dde4bbf P 29cbc59664a4430482375ad4bff0b6a4: Deleting consensus metadata
I20260810 06:30:16.157272 24920 ts_tablet_manager.cc:1918] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:16.157383 24920 log.cc:1196] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/7b9922674e2f48b7b44ef19b0dde4bbf
I20260810 06:30:16.157730 24920 ts_tablet_manager.cc:1939] T 7b9922674e2f48b7b44ef19b0dde4bbf P e4cc7a023b3b4ebead1694873a09b304: Deleting consensus metadata
I20260810 06:30:16.158002 24072 catalog_manager.cc:4841] TS 29cbc59664a4430482375ad4bff0b6a4 (127.21.195.194:41747): tablet 7b9922674e2f48b7b44ef19b0dde4bbf (table test-table [id=912d137c1dd64d36ad3ea1f32a31c779]) successfully deleted
I20260810 06:30:16.158497 24750 tablet_service.cc:1467] Processing CreateTablet for tablet f938f50be0ee4fe8acc873c0129c6b8c (DEFAULT_TABLE table=test-table [id=f04e36d32ac64a90a9ba597247110e52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:16.158555 24319 tablet_service.cc:1467] Processing CreateTablet for tablet f938f50be0ee4fe8acc873c0129c6b8c (DEFAULT_TABLE table=test-table [id=f04e36d32ac64a90a9ba597247110e52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:16.158811 24319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f938f50be0ee4fe8acc873c0129c6b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:16.158823 24750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f938f50be0ee4fe8acc873c0129c6b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:16.159304 24536 tablet_service.cc:1467] Processing CreateTablet for tablet f938f50be0ee4fe8acc873c0129c6b8c (DEFAULT_TABLE table=test-table [id=f04e36d32ac64a90a9ba597247110e52]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:16.159570 24536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f938f50be0ee4fe8acc873c0129c6b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:16.161038 24921 ts_tablet_manager.cc:1905] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:16.161201 24890 tablet_bootstrap.cc:492] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: Bootstrap starting.
I20260810 06:30:16.162056 24883 tablet_bootstrap.cc:492] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: Bootstrap starting.
I20260810 06:30:16.162412 24890 tablet_bootstrap.cc:654] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:16.162910 24072 catalog_manager.cc:4841] TS e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887): tablet 7b9922674e2f48b7b44ef19b0dde4bbf (table test-table [id=912d137c1dd64d36ad3ea1f32a31c779]) successfully deleted
I20260810 06:30:16.163079 24883 tablet_bootstrap.cc:654] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:16.164281 24886 tablet_bootstrap.cc:492] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: Bootstrap starting.
I20260810 06:30:16.165124 24883 tablet_bootstrap.cc:492] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: No bootstrap required, opened a new log
I20260810 06:30:16.165226 24883 ts_tablet_manager.cc:1397] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:16.165655 24886 tablet_bootstrap.cc:654] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:16.165830 24883 raft_consensus.cc:348] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.165983 24883 raft_consensus.cc:374] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:16.166028 24883 raft_consensus.cc:729] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cbc59664a4430482375ad4bff0b6a4, State: Initialized, Role: FOLLOWER
I20260810 06:30:16.166191 24883 consensus_queue.cc:260] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.166412 24921 ts_tablet_manager.cc:1918] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:16.166486 24883 ts_tablet_manager.cc:1428] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260810 06:30:16.166620 24921 log.cc:1196] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/7b9922674e2f48b7b44ef19b0dde4bbf
I20260810 06:30:16.167017 24921 ts_tablet_manager.cc:1939] T 7b9922674e2f48b7b44ef19b0dde4bbf P 0f3a7d5647ef485f813d478453b162fc: Deleting consensus metadata
I20260810 06:30:16.167891 24890 tablet_bootstrap.cc:492] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: No bootstrap required, opened a new log
I20260810 06:30:16.168004 24890 ts_tablet_manager.cc:1397] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 06:30:16.168761 24070 catalog_manager.cc:4841] TS 0f3a7d5647ef485f813d478453b162fc (127.21.195.195:36735): tablet 7b9922674e2f48b7b44ef19b0dde4bbf (table test-table [id=912d137c1dd64d36ad3ea1f32a31c779]) successfully deleted
I20260810 06:30:16.168872 24890 raft_consensus.cc:348] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.169013 24890 raft_consensus.cc:374] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:16.169057 24890 raft_consensus.cc:729] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cc7a023b3b4ebead1694873a09b304, State: Initialized, Role: FOLLOWER
I20260810 06:30:16.169203 24890 consensus_queue.cc:260] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.169485 24886 tablet_bootstrap.cc:492] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: No bootstrap required, opened a new log
I20260810 06:30:16.169499 24890 ts_tablet_manager.cc:1428] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:16.169606 24886 ts_tablet_manager.cc:1397] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260810 06:30:16.170081 24886 raft_consensus.cc:348] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.170203 24886 raft_consensus.cc:374] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:16.170248 24886 raft_consensus.cc:729] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3a7d5647ef485f813d478453b162fc, State: Initialized, Role: FOLLOWER
I20260810 06:30:16.170392 24886 consensus_queue.cc:260] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.170693 24886 ts_tablet_manager.cc:1428] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:16.504506 24897 raft_consensus.cc:482] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:16.504673 24897 raft_consensus.cc:504] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.505131 24897 leader_election.cc:288] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887), 29cbc59664a4430482375ad4bff0b6a4 (127.21.195.194:41747)
I20260810 06:30:16.505697 24561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f938f50be0ee4fe8acc873c0129c6b8c" candidate_uuid: "0f3a7d5647ef485f813d478453b162fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cbc59664a4430482375ad4bff0b6a4" is_pre_election: true
I20260810 06:30:16.505717 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f938f50be0ee4fe8acc873c0129c6b8c" candidate_uuid: "0f3a7d5647ef485f813d478453b162fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cc7a023b3b4ebead1694873a09b304" is_pre_election: true
I20260810 06:30:16.505859 24561 raft_consensus.cc:2454] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3a7d5647ef485f813d478453b162fc in term 0.
I20260810 06:30:16.505888 24351 raft_consensus.cc:2454] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3a7d5647ef485f813d478453b162fc in term 0.
I20260810 06:30:16.506191 24674 leader_election.cc:302] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3a7d5647ef485f813d478453b162fc, e4cc7a023b3b4ebead1694873a09b304; no voters:
I20260810 06:30:16.506381 24897 raft_consensus.cc:2781] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:16.506458 24897 raft_consensus.cc:482] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:16.506505 24897 raft_consensus.cc:3037] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.507716 24897 raft_consensus.cc:504] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.508116 24897 leader_election.cc:288] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [CANDIDATE]: Term 1 election: Requested vote from peers e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887), 29cbc59664a4430482375ad4bff0b6a4 (127.21.195.194:41747)
I20260810 06:30:16.508585 24561 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f938f50be0ee4fe8acc873c0129c6b8c" candidate_uuid: "0f3a7d5647ef485f813d478453b162fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29cbc59664a4430482375ad4bff0b6a4"
I20260810 06:30:16.508596 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f938f50be0ee4fe8acc873c0129c6b8c" candidate_uuid: "0f3a7d5647ef485f813d478453b162fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cc7a023b3b4ebead1694873a09b304"
I20260810 06:30:16.508716 24561 raft_consensus.cc:3037] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.508726 24351 raft_consensus.cc:3037] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.509765 24561 raft_consensus.cc:2454] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3a7d5647ef485f813d478453b162fc in term 1.
I20260810 06:30:16.509938 24351 raft_consensus.cc:2454] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3a7d5647ef485f813d478453b162fc in term 1.
I20260810 06:30:16.510185 24674 leader_election.cc:302] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3a7d5647ef485f813d478453b162fc, 29cbc59664a4430482375ad4bff0b6a4; no voters:
I20260810 06:30:16.510394 24897 raft_consensus.cc:2781] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:16.510497 24897 raft_consensus.cc:686] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 1 LEADER]: Becoming Leader. State: Replica: 0f3a7d5647ef485f813d478453b162fc, State: Running, Role: LEADER
I20260810 06:30:16.510658 24897 consensus_queue.cc:237] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.512729 24093 catalog_manager.cc:5495] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3a7d5647ef485f813d478453b162fc (127.21.195.195). New cstate: current_term: 1 leader_uuid: "0f3a7d5647ef485f813d478453b162fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } health_report { overall_health: HEALTHY } } }
Aug 10 06:30:16 dist-test-slave-7lbf krb5kdc[24023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343414, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:16.568255 24936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.559577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44413 (local address 127.0.0.1:60144)
0810 06:30:16.559968 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:16.559982 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:16.560097 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:16.560407 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:16.560409 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:16.560890 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:16.561020 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.561027 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.561943 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.561945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.562518 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.562525 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.562991 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.562993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.563053 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.563625 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:16.563637 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:16.565139 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:16.566716 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:16.566728 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:16.566735 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:16.566977 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:16.567208 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:16.567211 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:16.567213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:16.567310 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:16.567712 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:16.567718 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:16.567839 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 06:30:16.567928 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 06:30:16.568069 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":142,"threads_started":1}
I20260810 06:30:16.568269 24937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.559625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60144 (local address 127.21.195.254:44413)
0810 06:30:16.559934 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.559945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.560053 (+ 108us) server_negotiation.cc:407] Connection header received
0810 06:30:16.560196 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.560199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.560245 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.560350 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:16.561133 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.561848 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.562606 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.562882 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.562960 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.565289 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:16.565292 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:16.565294 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:16.565317 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:16.566619 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:16.567056 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:16.567058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:16.567060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:16.567134 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:16.567417 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:16.567419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:16.567421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:16.567625 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:16.567702 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.567972 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.568134 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":204,"thread_start_us":115,"threads_started":1}
I20260810 06:30:16.572664 24093 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:60144:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 06:30:16.573496 24093 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:16.578737 24536 tablet_service.cc:1467] Processing CreateTablet for tablet aee4b7337834438697000b58997a5ed7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b996064397814e67b8b02eccf71e058a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:16.578763 24750 tablet_service.cc:1467] Processing CreateTablet for tablet aee4b7337834438697000b58997a5ed7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b996064397814e67b8b02eccf71e058a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:16.578763 24319 tablet_service.cc:1467] Processing CreateTablet for tablet aee4b7337834438697000b58997a5ed7 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b996064397814e67b8b02eccf71e058a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:16.579264 24536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee4b7337834438697000b58997a5ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:16.579264 24319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee4b7337834438697000b58997a5ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:16.579264 24750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aee4b7337834438697000b58997a5ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:16.582239 24883 tablet_bootstrap.cc:492] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: Bootstrap starting.
I20260810 06:30:16.582348 24886 tablet_bootstrap.cc:492] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: Bootstrap starting.
I20260810 06:30:16.583221 24883 tablet_bootstrap.cc:654] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:16.583289 24886 tablet_bootstrap.cc:654] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:16.583618 24890 tablet_bootstrap.cc:492] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: Bootstrap starting.
I20260810 06:30:16.584455 24886 tablet_bootstrap.cc:492] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: No bootstrap required, opened a new log
I20260810 06:30:16.584556 24886 ts_tablet_manager.cc:1397] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260810 06:30:16.584995 24890 tablet_bootstrap.cc:654] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:16.585068 24883 tablet_bootstrap.cc:492] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: No bootstrap required, opened a new log
I20260810 06:30:16.585032 24886 raft_consensus.cc:348] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.585150 24883 ts_tablet_manager.cc:1397] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:16.585168 24886 raft_consensus.cc:374] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:16.585206 24886 raft_consensus.cc:729] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3a7d5647ef485f813d478453b162fc, State: Initialized, Role: FOLLOWER
I20260810 06:30:16.585338 24886 consensus_queue.cc:260] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.585659 24886 ts_tablet_manager.cc:1428] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260810 06:30:16.586002 24892 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.586169 24892 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:16.585680 24883 raft_consensus.cc:348] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.586407 24883 raft_consensus.cc:374] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:16.586464 24883 raft_consensus.cc:729] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29cbc59664a4430482375ad4bff0b6a4, State: Initialized, Role: FOLLOWER
I20260810 06:30:16.586635 24883 consensus_queue.cc:260] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.586699 24890 tablet_bootstrap.cc:492] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: No bootstrap required, opened a new log
I20260810 06:30:16.586781 24890 ts_tablet_manager.cc:1397] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 06:30:16.586894 24893 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.587056 24893 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:16.587368 24890 raft_consensus.cc:348] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.587487 24890 raft_consensus.cc:374] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:16.587522 24890 raft_consensus.cc:729] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4cc7a023b3b4ebead1694873a09b304, State: Initialized, Role: FOLLOWER
I20260810 06:30:16.587630 24883 ts_tablet_manager.cc:1428] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:30:16.587643 24890 consensus_queue.cc:260] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.587896 24895 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.588069 24895 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:16.588502 24890 ts_tablet_manager.cc:1428] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260810 06:30:16.678194 24893 raft_consensus.cc:482] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:16.678390 24893 raft_consensus.cc:504] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.679651 24893 leader_election.cc:288] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887), 0f3a7d5647ef485f813d478453b162fc (127.21.195.195:36735)
I20260810 06:30:16.685371 24945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.680299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:60459 (local address 127.21.195.195:36735)
0810 06:30:16.680541 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.680545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.680738 (+ 193us) server_negotiation.cc:407] Connection header received
0810 06:30:16.680901 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.680904 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.680958 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.681053 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:16.681261 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.682140 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.683898 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.684576 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.684712 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.684774 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.685113 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.685206 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":65,"threads_started":1}
I20260810 06:30:16.685371 24946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.680294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:36851 (local address 127.21.195.193:40887)
0810 06:30:16.680688 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.680693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.680707 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:30:16.680763 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.680766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.680818 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.680905 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:16.681259 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.682140 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.683890 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.684587 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.684712 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.684774 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.685110 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.685206 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":82,"threads_started":1}
I20260810 06:30:16.685477 24942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.679942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:40887 (local address 127.21.195.194:36851)
0810 06:30:16.680310 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:16.680327 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:16.680463 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:16.680947 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:16.680951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:16.680974 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:16.681111 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.681119 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.682253 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.682256 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.683750 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.683756 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.684728 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.684732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.684943 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.685015 (+ 72us) client_negotiation.cc:769] Sending connection context
0810 06:30:16.685084 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 06:30:16.685259 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":149,"thread_start_us":91,"threads_started":1}
I20260810 06:30:16.685884 24943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.679968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:36735 (local address 127.21.195.194:60459)
0810 06:30:16.680637 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:16.680653 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:16.680764 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:16.681061 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:16.681064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:16.681080 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:16.681159 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.681164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.682271 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.682274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.683735 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.683751 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.684728 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.684732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.684927 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.685004 (+ 77us) client_negotiation.cc:769] Sending connection context
0810 06:30:16.685084 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 06:30:16.685263 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"mutex_wait_us":125,"thread_start_us":80,"threads_started":1}
I20260810 06:30:16.685958 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee4b7337834438697000b58997a5ed7" candidate_uuid: "29cbc59664a4430482375ad4bff0b6a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cc7a023b3b4ebead1694873a09b304" is_pre_election: true
I20260810 06:30:16.686151 24351 raft_consensus.cc:2454] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29cbc59664a4430482375ad4bff0b6a4 in term 0.
I20260810 06:30:16.686498 24776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee4b7337834438697000b58997a5ed7" candidate_uuid: "29cbc59664a4430482375ad4bff0b6a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3a7d5647ef485f813d478453b162fc" is_pre_election: true
I20260810 06:30:16.686583 24463 leader_election.cc:302] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cbc59664a4430482375ad4bff0b6a4, e4cc7a023b3b4ebead1694873a09b304; no voters:
I20260810 06:30:16.686776 24776 raft_consensus.cc:2454] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29cbc59664a4430482375ad4bff0b6a4 in term 0.
I20260810 06:30:16.686918 24893 raft_consensus.cc:2781] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:16.687011 24893 raft_consensus.cc:482] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:16.687058 24893 raft_consensus.cc:3037] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.688170 24893 raft_consensus.cc:504] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.688541 24893 leader_election.cc:288] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [CANDIDATE]: Term 1 election: Requested vote from peers e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887), 0f3a7d5647ef485f813d478453b162fc (127.21.195.195:36735)
I20260810 06:30:16.688926 24351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee4b7337834438697000b58997a5ed7" candidate_uuid: "29cbc59664a4430482375ad4bff0b6a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4cc7a023b3b4ebead1694873a09b304"
I20260810 06:30:16.689043 24351 raft_consensus.cc:3037] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.689677 24776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aee4b7337834438697000b58997a5ed7" candidate_uuid: "29cbc59664a4430482375ad4bff0b6a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3a7d5647ef485f813d478453b162fc"
I20260810 06:30:16.689796 24776 raft_consensus.cc:3037] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:16.690109 24351 raft_consensus.cc:2454] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cbc59664a4430482375ad4bff0b6a4 in term 1.
I20260810 06:30:16.690446 24463 leader_election.cc:302] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29cbc59664a4430482375ad4bff0b6a4, e4cc7a023b3b4ebead1694873a09b304; no voters:
I20260810 06:30:16.690680 24893 raft_consensus.cc:2781] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:16.690876 24893 raft_consensus.cc:686] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [term 1 LEADER]: Becoming Leader. State: Replica: 29cbc59664a4430482375ad4bff0b6a4, State: Running, Role: LEADER
I20260810 06:30:16.691128 24776 raft_consensus.cc:2454] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29cbc59664a4430482375ad4bff0b6a4 in term 1.
I20260810 06:30:16.691169 24893 consensus_queue.cc:237] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } }
I20260810 06:30:16.692574 24947 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: TxnStatusTablet state changed. Reason: New leader 29cbc59664a4430482375ad4bff0b6a4. Latest consensus state: current_term: 1 leader_uuid: "29cbc59664a4430482375ad4bff0b6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.692701 24947 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:16.693033 24949 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 06:30:16.693256 24949 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 06:30:16.693790 24091 catalog_manager.cc:5495] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29cbc59664a4430482375ad4bff0b6a4 (127.21.195.194). New cstate: current_term: 1 leader_uuid: "29cbc59664a4430482375ad4bff0b6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } health_report { overall_health: UNKNOWN } } }
I20260810 06:30:16.716933 24936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.712255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:41747 (local address 127.0.0.1:60592)
0810 06:30:16.712442 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:16.712459 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:16.712569 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:16.713061 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:16.713064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:16.713073 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:16.713197 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.713205 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.714388 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.714391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.715025 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.715034 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.715520 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.715523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.715627 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.715683 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:16.716627 (+ 944us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:16.716643 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 06:30:16.716685 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 06:30:16.716773 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 06:30:16.716980 24960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.712407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60592 (local address 127.21.195.194:41747)
0810 06:30:16.712753 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.712762 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.712774 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:30:16.712845 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.712847 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.712901 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.713028 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:16.713719 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.714271 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.715148 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.715406 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.715510 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.715879 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:16.716523 (+ 644us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:16.716680 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.716722 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.716794 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":125,"threads_started":1}
I20260810 06:30:16.720757 24351 raft_consensus.cc:1261] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Refusing update from remote peer 29cbc59664a4430482375ad4bff0b6a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:16.721077 24776 raft_consensus.cc:1261] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc [term 1 FOLLOWER]: Refusing update from remote peer 29cbc59664a4430482375ad4bff0b6a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:16.721297 24947 consensus_queue.cc:1035] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:16.721733 24893 consensus_queue.cc:1035] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:16.723026 24895 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: TxnStatusTablet state changed. Reason: New leader 29cbc59664a4430482375ad4bff0b6a4. Latest consensus state: current_term: 1 leader_uuid: "29cbc59664a4430482375ad4bff0b6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.723202 24895 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:16.723788 24892 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: TxnStatusTablet state changed. Reason: New leader 29cbc59664a4430482375ad4bff0b6a4. Latest consensus state: current_term: 1 leader_uuid: "29cbc59664a4430482375ad4bff0b6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.723938 24892 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:16.726347 24893 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29cbc59664a4430482375ad4bff0b6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.726480 24893 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:16.726826 24893 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "29cbc59664a4430482375ad4bff0b6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.726922 24893 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P 29cbc59664a4430482375ad4bff0b6a4: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:16.728296 24895 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29cbc59664a4430482375ad4bff0b6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.728432 24895 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P e4cc7a023b3b4ebead1694873a09b304: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:16.729807 24892 tablet_replica.cc:439] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "29cbc59664a4430482375ad4bff0b6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 } } peers { permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 } } peers { permanent_uuid: "0f3a7d5647ef485f813d478453b162fc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36735 } } }
I20260810 06:30:16.729930 24892 tablet_replica.cc:442] T aee4b7337834438697000b58997a5ed7 P 0f3a7d5647ef485f813d478453b162fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:16.730954 24967 mvcc.cc:205] Tried to move back new op lower bound from 7316862634882359296 to 7316862634769780736. Current Snapshot: MvccSnapshot[applied={T|T < 7316862634882359296}]
I20260810 06:30:16.746461 24976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.741753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:41747 (local address 127.21.195.195:60309)
0810 06:30:16.742253 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:16.742268 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:16.742382 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:16.742654 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:16.742657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:16.742664 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:16.742776 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.742781 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.743869 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.743873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.744916 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.744930 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.745627 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.745631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.745730 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.745791 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:16.746141 (+ 350us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:16.746147 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:30:16.746201 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 06:30:16.746298 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":148,"threads_started":1}
I20260810 06:30:16.746461 24960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.741881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:60309 (local address 127.21.195.194:41747)
0810 06:30:16.742122 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.742129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.742348 (+ 219us) server_negotiation.cc:407] Connection header received
0810 06:30:16.742474 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.742478 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.742541 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.742635 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:16.742919 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.743743 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.745059 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.745435 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.745615 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.745944 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:16.746046 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:16.746124 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.746227 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.746304 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:16.757467 24351 raft_consensus.cc:1261] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Refusing update from remote peer 0f3a7d5647ef485f813d478453b162fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:16.757496 24561 raft_consensus.cc:1261] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Refusing update from remote peer 0f3a7d5647ef485f813d478453b162fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:16.757941 24897 consensus_queue.cc:1035] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4cc7a023b3b4ebead1694873a09b304" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 40887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:16.760241 24897 consensus_queue.cc:1035] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "29cbc59664a4430482375ad4bff0b6a4" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 41747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:16.784710 24945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.778523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:50311 (local address 127.21.195.195:36735)
0810 06:30:16.778651 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.778656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.778673 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:30:16.778795 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.778798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.778872 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.778951 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:16.779422 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.780193 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.783403 (+ 3210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.783639 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.783741 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.784169 (+ 428us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:16.784256 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:16.784349 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.784482 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.784568 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:30:16.784839 24982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.778152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:36735 (local address 127.21.195.194:50311)
0810 06:30:16.778568 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:16.778586 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:16.778696 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:16.778982 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:16.778986 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:16.778996 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:16.779243 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.779263 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.782349 (+ 3086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.782352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.783275 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:16.783285 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.783847 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.783850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:16.783933 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.783986 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:16.784391 (+ 405us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:16.784397 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:30:16.784453 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 06:30:16.784554 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":149,"threads_started":1}
I20260810 06:30:16.813983 24086 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:16.814196 24086 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:16.816720 24086 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b14d4a3b47aa40e1996f2e6112b85e4e: Sending DeleteTablet for 3 replicas of tablet f938f50be0ee4fe8acc873c0129c6b8c
I20260810 06:30:16.817399 24319 tablet_service.cc:1514] Processing DeleteTablet for tablet f938f50be0ee4fe8acc873c0129c6b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:16 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:45136
I20260810 06:30:16.817441 24536 tablet_service.cc:1514] Processing DeleteTablet for tablet f938f50be0ee4fe8acc873c0129c6b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:16 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:60578
I20260810 06:30:16.817483 24750 tablet_service.cc:1514] Processing DeleteTablet for tablet f938f50be0ee4fe8acc873c0129c6b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:16 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:53770
I20260810 06:30:16.818071 24988 tablet_replica.cc:330] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: stopping tablet replica
I20260810 06:30:16.818063 24984 tablet_replica.cc:330] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: stopping tablet replica
I20260810 06:30:16.818230 24984 raft_consensus.cc:2229] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:16.818368 24984 raft_consensus.cc:2258] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:16.818491 24989 tablet_replica.cc:330] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: stopping tablet replica
I20260810 06:30:16.818681 24988 raft_consensus.cc:2229] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:16.818863 24989 raft_consensus.cc:2229] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:16.819051 24988 raft_consensus.cc:2258] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:16.819193 24984 ts_tablet_manager.cc:1905] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:16.819391 24989 raft_consensus.cc:2258] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:16.820199 24989 ts_tablet_manager.cc:1905] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:16.820300 24988 ts_tablet_manager.cc:1905] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:16.822726 24984 ts_tablet_manager.cc:1918] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:16.822818 24984 log.cc:1196] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/f938f50be0ee4fe8acc873c0129c6b8c
I20260810 06:30:16.823148 24984 ts_tablet_manager.cc:1939] T f938f50be0ee4fe8acc873c0129c6b8c P 29cbc59664a4430482375ad4bff0b6a4: Deleting consensus metadata
I20260810 06:30:16.823858 24989 ts_tablet_manager.cc:1918] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:16.824016 24989 log.cc:1196] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/f938f50be0ee4fe8acc873c0129c6b8c
I20260810 06:30:16.824015 24988 ts_tablet_manager.cc:1918] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:16.824009 24072 catalog_manager.cc:4841] TS 29cbc59664a4430482375ad4bff0b6a4 (127.21.195.194:41747): tablet f938f50be0ee4fe8acc873c0129c6b8c (table test-table [id=f04e36d32ac64a90a9ba597247110e52]) successfully deleted
I20260810 06:30:16.824110 24988 log.cc:1196] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/f938f50be0ee4fe8acc873c0129c6b8c
I20260810 06:30:16.824425 24989 ts_tablet_manager.cc:1939] T f938f50be0ee4fe8acc873c0129c6b8c P 0f3a7d5647ef485f813d478453b162fc: Deleting consensus metadata
I20260810 06:30:16.824440 24988 ts_tablet_manager.cc:1939] T f938f50be0ee4fe8acc873c0129c6b8c P e4cc7a023b3b4ebead1694873a09b304: Deleting consensus metadata
I20260810 06:30:16.825168 24070 catalog_manager.cc:4841] TS 0f3a7d5647ef485f813d478453b162fc (127.21.195.195:36735): tablet f938f50be0ee4fe8acc873c0129c6b8c (table test-table [id=f04e36d32ac64a90a9ba597247110e52]) successfully deleted
I20260810 06:30:16.825294 24072 catalog_manager.cc:4841] TS e4cc7a023b3b4ebead1694873a09b304 (127.21.195.193:40887): tablet f938f50be0ee4fe8acc873c0129c6b8c (table test-table [id=f04e36d32ac64a90a9ba597247110e52]) successfully deleted
Aug 10 06:30:16 dist-test-slave-7lbf krb5kdc[24023](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343415, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:16.836292 24946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.825390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45150 (local address 127.21.195.193:40887)
0810 06:30:16.825560 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.825565 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.826010 (+ 445us) server_negotiation.cc:407] Connection header received
0810 06:30:16.826104 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.826107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.826166 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.826272 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:16.826911 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.827645 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.828484 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.828857 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.828975 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.831899 (+ 2924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:16.831916 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:16.831934 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:16.831969 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:16.834126 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:16.834585 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:16.834593 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:16.834595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:16.834723 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:16.835032 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:16.835035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:16.835037 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:16.835434 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:16.835698 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.835915 (+ 217us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.836064 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 06:30:16.837062 24408 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45150
I20260810 06:30:16.848066 24937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:16.839278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60150 (local address 127.21.195.254:44413)
0810 06:30:16.839430 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:16.839433 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:16.839543 (+ 110us) server_negotiation.cc:407] Connection header received
0810 06:30:16.839704 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:16.839707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:16.839752 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:16.839823 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:16.840744 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.841283 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.842546 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:16.842791 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:16.842873 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:16.844806 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:16.844809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:16.844812 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:16.844841 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:16.846329 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:16.846843 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:16.846845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:16.846846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:16.846943 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:16.847217 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:16.847219 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:16.847220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:16.847404 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:16.847507 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:16.847796 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 06:30:16.847922 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260810 06:30:16.848754 24086 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60150
I20260810 06:30:16.850243 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24216
I20260810 06:30:16.868098 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24426
I20260810 06:30:16.886077 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24646
I20260810 06:30:16.904763 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24041
2026-08-10T06:30:16Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3521 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:16 dist-test-slave-7lbf krb5kdc[25004](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:16 dist-test-slave-7lbf krb5kdc[25004](info): set up 2 sockets
Aug 10 06:30:16 dist-test-slave-7lbf krb5kdc[25004](info): commencing operation
krb5kdc: starting...
W20260810 06:30:18.074386 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:18 dist-test-slave-7lbf krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:18.208930 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:38025
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:38025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:18.331897 25027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:18.332244 25027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:18.332314 25027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:18.336608 25027 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:18.336696 25027 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 06:30:18.336720 25027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:18.336745 25027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:18.336766 25027 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:18.336788 25027 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:18.342567 25027 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:38025
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:38025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:18.343883 25027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:18.345067 25027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:18.354673 25035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:18.354727 25027 server_base.cc:1034] running on GCE node
W20260810 06:30:18.354678 25034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:18.354673 25041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:18.355556 25027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:18.356849 25027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:18.358042 25027 hybrid_clock.cc:648] HybridClock initialized: now 1786343418358007 us; error 47 us; skew 500 ppm
Aug 10 06:30:18 dist-test-slave-7lbf krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343418, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:18.365176 25027 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:18.366354 25027 webserver.cc:460] Webserver started at http://127.21.195.254:41125/ using document root <none> and password file <none>
I20260810 06:30:18.367012 25027 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:18.367091 25027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:18.367328 25027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:18.369683 25027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "f374ef5dc89746549587c92fb205c063"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "13e2a731bc6419f749d831e7b55de2ee"
server_key_iv: "d28d6f57dcf339ae13c5162223b971ef"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.370314 25027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "f374ef5dc89746549587c92fb205c063"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "13e2a731bc6419f749d831e7b55de2ee"
server_key_iv: "d28d6f57dcf339ae13c5162223b971ef"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.374742 25027 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:18.377486 25051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:18.378976 25027 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:18.379127 25027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "f374ef5dc89746549587c92fb205c063"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "13e2a731bc6419f749d831e7b55de2ee"
server_key_iv: "d28d6f57dcf339ae13c5162223b971ef"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.379246 25027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:18.395157 25027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:18.398494 25027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:18.398707 25027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:18.407022 25027 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:38025
I20260810 06:30:18.407028 25155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:38025 every 8 connection(s)
I20260810 06:30:18.408115 25027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:18.411351 25156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:18.417332 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25027
I20260810 06:30:18.417457 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:18.417730 22287 external_mini_cluster.cc:1428] Setting key 39c88d1b964e33dd63f21bcd9f77c8c4
I20260810 06:30:18.417726 25156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: Bootstrap starting.
I20260810 06:30:18.420511 25156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:18.421411 25156 log.cc:824] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:18.423722 25156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: No bootstrap required, opened a new log
Aug 10 06:30:18 dist-test-slave-7lbf krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:18.428454 25156 raft_consensus.cc:348] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f374ef5dc89746549587c92fb205c063" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38025 } }
I20260810 06:30:18.428745 25156 raft_consensus.cc:374] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:18.428840 25156 raft_consensus.cc:729] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f374ef5dc89746549587c92fb205c063, State: Initialized, Role: FOLLOWER
I20260810 06:30:18.429417 25156 consensus_queue.cc:260] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f374ef5dc89746549587c92fb205c063" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38025 } }
I20260810 06:30:18.429626 25156 raft_consensus.cc:388] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:18.429701 25156 raft_consensus.cc:482] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:18.429807 25156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:18.431051 25156 raft_consensus.cc:504] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f374ef5dc89746549587c92fb205c063" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38025 } }
I20260810 06:30:18.431469 25156 leader_election.cc:302] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f374ef5dc89746549587c92fb205c063; no voters:
I20260810 06:30:18.431845 25156 leader_election.cc:288] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:18.431941 25169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:18.432231 25169 raft_consensus.cc:686] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [term 1 LEADER]: Becoming Leader. State: Replica: f374ef5dc89746549587c92fb205c063, State: Running, Role: LEADER
I20260810 06:30:18.432813 25169 consensus_queue.cc:237] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f374ef5dc89746549587c92fb205c063" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38025 } }
I20260810 06:30:18.433465 25156 sys_catalog.cc:564] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:18.433730 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.419210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44120 (local address 127.21.195.254:38025)
0810 06:30:18.419720 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:18.419738 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:18.419780 (+ 42us) server_negotiation.cc:407] Connection header received
0810 06:30:18.420517 (+ 737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:18.420540 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:18.420979 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:18.421302 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:18.422295 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.423339 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.424584 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.425101 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.425250 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.428258 (+ 3008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:18.428265 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:18.428283 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:18.428316 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:18.430319 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.430863 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.430869 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.430873 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.431004 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.431302 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.431305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.431306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.431802 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:18.432024 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:18.432334 (+ 310us) server_negotiation.cc:299] Negotiation successful
0810 06:30:18.432704 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":184,"threads_started":1}
I20260810 06:30:18.434684 25171 sys_catalog.cc:455] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f374ef5dc89746549587c92fb205c063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f374ef5dc89746549587c92fb205c063" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38025 } } }
I20260810 06:30:18.434825 25171 sys_catalog.cc:458] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:18.435129 25170 sys_catalog.cc:455] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f374ef5dc89746549587c92fb205c063. Latest consensus state: current_term: 1 leader_uuid: "f374ef5dc89746549587c92fb205c063" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f374ef5dc89746549587c92fb205c063" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38025 } } }
I20260810 06:30:18.435221 25170 sys_catalog.cc:458] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063 [sys.catalog]: This master's current role is: LEADER
W20260810 06:30:18.439088 25188 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:30:18.439186 25188 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:30:18.439270 25181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:18.439993 25181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:18.446653 25181 catalog_manager.cc:1347] Generated new cluster ID: b7c85e81defc45798b495ec29dca859a
I20260810 06:30:18.446748 25181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:18.464459 25181 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:18.465572 25181 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:18.478662 25181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: Generated new TSK 0
I20260810 06:30:18.479504 25181 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:18.521040 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:38025
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:18.655498 25198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:18.655860 25198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:18.655916 25198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:18.660223 25198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:18.660321 25198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:18.660369 25198 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 06:30:18.660386 25198 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:18.660431 25198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:18.666371 25198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:38025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:18.667603 25198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:18.668769 25198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:18.679870 25209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:18.679953 25205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:18.680083 25198 server_base.cc:1034] running on GCE node
W20260810 06:30:18.679958 25211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:18.680660 25198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:18.681434 25198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:18.682615 25198 hybrid_clock.cc:648] HybridClock initialized: now 1786343418682590 us; error 40 us; skew 500 ppm
Aug 10 06:30:18 dist-test-slave-7lbf krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343418, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:18.685806 25198 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:18.686849 25198 webserver.cc:460] Webserver started at http://127.21.195.193:45399/ using document root <none> and password file <none>
I20260810 06:30:18.687474 25198 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:18.687546 25198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:18.687757 25198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:18.690112 25198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "6b6a71c0e0ec4999a271092b5aed5df9"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "f650cd210763e146a47c5949bc61c9c4"
server_key_iv: "7b29856458b45e14d42c7f4dc8915e6a"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.690750 25198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "6b6a71c0e0ec4999a271092b5aed5df9"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "f650cd210763e146a47c5949bc61c9c4"
server_key_iv: "7b29856458b45e14d42c7f4dc8915e6a"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.695073 25198 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:18.698078 25225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:18.699512 25198 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:18.699654 25198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "6b6a71c0e0ec4999a271092b5aed5df9"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "f650cd210763e146a47c5949bc61c9c4"
server_key_iv: "7b29856458b45e14d42c7f4dc8915e6a"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.699782 25198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:18.723438 25198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:18.727260 25198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:18.727469 25198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:18.729194 25198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:18.729256 25198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:18.729322 25198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:18.729362 25198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:30:18 dist-test-slave-7lbf krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343418, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:18.740742 25198 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:35461
I20260810 06:30:18.740805 25418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:35461 every 8 connection(s)
I20260810 06:30:18.741909 25198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:18.744238 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.730234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:51875 (local address 127.21.195.254:38025)
0810 06:30:18.730399 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:18.730405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:18.731508 (+ 1103us) server_negotiation.cc:407] Connection header received
0810 06:30:18.732824 (+ 1316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:18.732829 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:18.732900 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:18.733003 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:18.734950 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.735637 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.737162 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.737428 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.737548 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.740446 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:18.740449 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:18.740451 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:18.740481 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:18.741937 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.742613 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.742617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.742619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.742729 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.743097 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.743100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.743101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.743311 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:18.743401 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:18.743971 (+ 570us) server_negotiation.cc:299] Negotiation successful
0810 06:30:18.744107 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 06:30:18.745087 25243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.730733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:38025 (local address 127.21.195.193:51875)
0810 06:30:18.731300 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:18.731373 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:18.732551 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:18.733253 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:18.733264 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:18.733869 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:18.734721 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:18.734773 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.735785 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.735789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:18.737005 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:18.737017 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.737619 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.737623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:18.737828 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.738519 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:18.738541 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:18.740244 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:18.742071 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:18.742077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:18.742095 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:18.742491 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:18.742831 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:18.742834 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:18.742836 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:18.743014 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:18.743407 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:18.743413 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:18.743700 (+ 287us) client_negotiation.cc:769] Sending connection context
0810 06:30:18.743892 (+ 192us) client_negotiation.cc:240] Negotiation successful
0810 06:30:18.744180 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":129,"threads_started":1}
I20260810 06:30:18.746488 25419 heartbeater.cc:347] Connected to a master server at 127.21.195.254:38025
I20260810 06:30:18.746730 25419 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:18.747287 25419 heartbeater.cc:511] Master 127.21.195.254:38025 requested a full tablet report, sending...
I20260810 06:30:18.748924 25079 ts_manager.cc:194] Registered new tserver with Master: 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461)
I20260810 06:30:18.750196 25079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:51875
I20260810 06:30:18.750415 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25198
I20260810 06:30:18.750548 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:18.750865 22287 external_mini_cluster.cc:1428] Setting key dc7ae70b2d49cb6c8e567363964be3ee
I20260810 06:30:18.756600 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.749053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:43879 (local address 127.21.195.254:38025)
0810 06:30:18.749219 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:18.749224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:18.749346 (+ 122us) server_negotiation.cc:407] Connection header received
0810 06:30:18.749456 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:18.749459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:18.749502 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:18.749597 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:18.750054 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.750809 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.751871 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.752098 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.752185 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.753610 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:18.753614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:18.753617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:18.753642 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:18.755031 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.755514 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.755517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.755518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.755597 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.755856 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.755859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.755860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.756029 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:18.756101 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:18.756376 (+ 275us) server_negotiation.cc:299] Negotiation successful
0810 06:30:18.756478 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 06:30:18.756665 25427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.748945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:38025 (local address 127.21.195.193:43879)
0810 06:30:18.749265 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:18.749279 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:18.749380 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:18.749614 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:18.749616 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:18.749835 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:18.749941 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:18.749947 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.750971 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.750974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:18.751762 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:18.751772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.752199 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.752202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:18.752290 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.752818 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:18.752833 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:18.753412 (+ 579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:18.755144 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:18.755147 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:18.755150 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:18.755425 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:18.755674 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:18.755677 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:18.755680 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:18.755774 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:18.756108 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:18.756111 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:18.756217 (+ 106us) client_negotiation.cc:769] Sending connection context
0810 06:30:18.756324 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 06:30:18.756468 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:18.781896 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:38025
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:18.907666 25433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:18.908015 25433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:18.908066 25433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:18.912569 25433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:18.912673 25433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:18.912719 25433 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 06:30:18.912738 25433 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:18.912779 25433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:18.918582 25433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:38025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:18.919848 25433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:18.921018 25433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:18.931852 25440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:18.931852 25443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:18.931953 25433 server_base.cc:1034] running on GCE node
W20260810 06:30:18.931852 25441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:18.932655 25433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:18.933427 25433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:18.934610 25433 hybrid_clock.cc:648] HybridClock initialized: now 1786343418934586 us; error 38 us; skew 500 ppm
Aug 10 06:30:18 dist-test-slave-7lbf krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343418, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:18.937752 25433 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:18.938869 25433 webserver.cc:460] Webserver started at http://127.21.195.194:46231/ using document root <none> and password file <none>
I20260810 06:30:18.939545 25433 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:18.939620 25433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:18.939868 25433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:18.942308 25433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "1b9488666d6f4f629fd26b1b9f308e62"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "3183d09791efd85aea4dc6b7bd730f04"
server_key_iv: "1a4510d470e3dc34dd8e7d8b41754c0b"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.942924 25433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "1b9488666d6f4f629fd26b1b9f308e62"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "3183d09791efd85aea4dc6b7bd730f04"
server_key_iv: "1a4510d470e3dc34dd8e7d8b41754c0b"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.947229 25433 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:18.950042 25454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:18.951536 25433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:18.951678 25433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "1b9488666d6f4f629fd26b1b9f308e62"
format_stamp: "Formatted at 2026-08-10 06:30:18 on dist-test-slave-7lbf"
server_key: "3183d09791efd85aea4dc6b7bd730f04"
server_key_iv: "1a4510d470e3dc34dd8e7d8b41754c0b"
server_key_version: "encryptionkey@0"
I20260810 06:30:18.951802 25433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:18.968058 25433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:18.971621 25433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:18.971827 25433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:18.973657 25433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:18.973714 25433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:18.973773 25433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:18.973798 25433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:30:18 dist-test-slave-7lbf krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343418, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:18.984740 25433 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:44097
I20260810 06:30:18.985730 25652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:44097 every 8 connection(s)
I20260810 06:30:18.985821 25433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:18.988006 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.974625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:37409 (local address 127.21.195.254:38025)
0810 06:30:18.974790 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:18.974796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:18.975741 (+ 945us) server_negotiation.cc:407] Connection header received
0810 06:30:18.976961 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:18.976965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:18.977035 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:18.977146 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:18.978746 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.979419 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.980803 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.981110 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.981214 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.984179 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:18.984185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:18.984188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:18.984224 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:18.985856 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.986467 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.986472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.986474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.986578 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.986963 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.986966 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.986968 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.987183 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:18.987266 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:18.987757 (+ 491us) server_negotiation.cc:299] Negotiation successful
0810 06:30:18.987874 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:18.988909 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.975045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:38025 (local address 127.21.195.194:37409)
0810 06:30:18.975553 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:18.975612 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:18.976634 (+ 1022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:18.977372 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:18.977380 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:18.977890 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:18.978574 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:18.978593 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.979566 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.979569 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:18.980650 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:18.980662 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.981317 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.981322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:18.981497 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.982170 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:18.982189 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:18.983952 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:18.985999 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:18.986005 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:18.986018 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:18.986343 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:18.986683 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:18.986687 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:18.986689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:18.986864 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:18.987272 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:18.987277 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:18.987549 (+ 272us) client_negotiation.cc:769] Sending connection context
0810 06:30:18.987718 (+ 169us) client_negotiation.cc:240] Negotiation successful
0810 06:30:18.988010 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":114,"threads_started":1}
I20260810 06:30:18.990218 25653 heartbeater.cc:347] Connected to a master server at 127.21.195.254:38025
I20260810 06:30:18.990259 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25433
I20260810 06:30:18.990365 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:18.990389 25653 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:18.990724 22287 external_mini_cluster.cc:1428] Setting key 1ba9fabdbbc5f270c067ec9d9759252e
I20260810 06:30:18.991007 25653 heartbeater.cc:511] Master 127.21.195.254:38025 requested a full tablet report, sending...
I20260810 06:30:18.992671 25079 ts_manager.cc:194] Registered new tserver with Master: 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097)
I20260810 06:30:18.993551 25079 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:37409
I20260810 06:30:19.000660 25668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.992859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:38025 (local address 127.21.195.194:38541)
0810 06:30:18.993213 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:18.993228 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:18.993345 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:18.993701 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:18.993703 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:18.993952 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:18.994089 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:18.994097 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.994932 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.994936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:18.995811 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:18.995823 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.996290 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.996294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:18.996389 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.996973 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:18.996984 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:18.997335 (+ 351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:18.999054 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:18.999058 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:18.999060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:18.999274 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:18.999555 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:18.999558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:18.999561 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:18.999648 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:19.000073 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:19.000076 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:19.000177 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.000264 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.000438 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":1,"thread_start_us":104,"threads_started":1}
I20260810 06:30:19.000655 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:18.992925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:38541 (local address 127.21.195.254:38025)
0810 06:30:18.993046 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:18.993051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:18.993304 (+ 253us) server_negotiation.cc:407] Connection header received
0810 06:30:18.993442 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:18.993445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:18.993492 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:18.993585 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:18.994220 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.994784 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.995952 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:18.996173 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:18.996257 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:18.997484 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:18.997487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:18.997489 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:18.997575 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:18.998944 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.999368 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.999372 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.999373 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.999464 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:18.999731 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:18.999734 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:18.999736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:18.999972 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:19.000066 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.000339 (+ 273us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.000481 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:19.022343 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:38025
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:19.145049 25672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:19.145385 25672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:19.145438 25672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:19.149739 25672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:19.149818 25672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:19.149861 25672 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 06:30:19.149878 25672 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:19.149931 25672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:19.155622 25672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:38025
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:19.156908 25672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:19.158080 25672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:19.170284 25689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:19.170286 25685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:19.171005 25692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:19.171025 25672 server_base.cc:1034] running on GCE node
I20260810 06:30:19.171519 25672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:19.172369 25672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:19.173560 25672 hybrid_clock.cc:648] HybridClock initialized: now 1786343419173525 us; error 56 us; skew 500 ppm
Aug 10 06:30:19 dist-test-slave-7lbf krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343419, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:19.176517 25672 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:19.177568 25672 webserver.cc:460] Webserver started at http://127.21.195.195:44919/ using document root <none> and password file <none>
I20260810 06:30:19.178229 25672 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:19.178308 25672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:19.178527 25672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:19.180905 25672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc"
format_stamp: "Formatted at 2026-08-10 06:30:19 on dist-test-slave-7lbf"
server_key: "3ba3612bdddb80b220d870d574d74a9b"
server_key_iv: "4332f52cc2c984c7025b6f77e6fd1cd2"
server_key_version: "encryptionkey@0"
I20260810 06:30:19.181566 25672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc"
format_stamp: "Formatted at 2026-08-10 06:30:19 on dist-test-slave-7lbf"
server_key: "3ba3612bdddb80b220d870d574d74a9b"
server_key_iv: "4332f52cc2c984c7025b6f77e6fd1cd2"
server_key_version: "encryptionkey@0"
I20260810 06:30:19.185978 25672 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:30:19.188719 25703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:19.190200 25672 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:19.190335 25672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc"
format_stamp: "Formatted at 2026-08-10 06:30:19 on dist-test-slave-7lbf"
server_key: "3ba3612bdddb80b220d870d574d74a9b"
server_key_iv: "4332f52cc2c984c7025b6f77e6fd1cd2"
server_key_version: "encryptionkey@0"
I20260810 06:30:19.190457 25672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:19.220532 25672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:19.224543 25672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:19.224771 25672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:19.226625 25672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:19.226701 25672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:19.226759 25672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:19.226801 25672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:30:19 dist-test-slave-7lbf krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343419, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:19.237437 25672 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:37499
I20260810 06:30:19.237478 25907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:37499 every 8 connection(s)
I20260810 06:30:19.238552 25672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:19.240613 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25672
I20260810 06:30:19.240746 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:19.241052 22287 external_mini_cluster.cc:1428] Setting key 11894b01f7f1aa980af25aff5efd60b1
I20260810 06:30:19.241616 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.227592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:46133 (local address 127.21.195.254:38025)
0810 06:30:19.227731 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.227736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.228809 (+ 1073us) server_negotiation.cc:407] Connection header received
0810 06:30:19.230070 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.230074 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.230138 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.230222 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:19.232100 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.232944 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.234426 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.234661 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.234757 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.237746 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:19.237750 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:19.237752 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:19.237788 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:19.239429 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:19.239981 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:19.239984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:19.239985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:19.240070 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:19.240347 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:19.240350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:19.240352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:19.240608 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:19.240712 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.241305 (+ 593us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.241442 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:19.242690 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.228123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:38025 (local address 127.21.195.195:46133)
0810 06:30:19.228633 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.228690 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.229830 (+ 1140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.230590 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.230601 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.231128 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:19.231921 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.231947 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.233094 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.233098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.234272 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.234296 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.234822 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.234826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.235025 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.235666 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:19.235689 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:19.237465 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:19.239549 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:19.239556 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:19.239571 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:19.239888 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:19.240135 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:19.240137 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:19.240138 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:19.240268 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:19.240726 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:19.240734 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:19.241033 (+ 299us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.241217 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.241602 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":119,"threads_started":1}
I20260810 06:30:19.244019 25908 heartbeater.cc:347] Connected to a master server at 127.21.195.254:38025
I20260810 06:30:19.244189 25908 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:19.244810 25908 heartbeater.cc:511] Master 127.21.195.254:38025 requested a full tablet report, sending...
I20260810 06:30:19.246011 25081 ts_manager.cc:194] Registered new tserver with Master: b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499)
I20260810 06:30:19.246765 25081 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:46133
I20260810 06:30:19.253897 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.246605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:51893 (local address 127.21.195.254:38025)
0810 06:30:19.246742 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.246746 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.246942 (+ 196us) server_negotiation.cc:407] Connection header received
0810 06:30:19.247067 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.247071 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.247116 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.247179 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:19.247762 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.248514 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.249560 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.249790 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.249876 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.250991 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:19.250995 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:19.250997 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:19.251025 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:19.252260 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:19.252669 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:19.252673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:19.252675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:19.252760 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:19.253025 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:19.253028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:19.253030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:19.253218 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:19.253308 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.253605 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.253721 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:30:19.253909 25921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.246527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:38025 (local address 127.21.195.195:51893)
0810 06:30:19.246867 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.246882 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.246985 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.247207 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.247209 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.247460 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:19.247584 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.247592 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.248674 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.248677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.249422 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.249432 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.249895 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.249899 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.249989 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.250479 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:19.250494 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:19.250848 (+ 354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:19.252368 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:19.252372 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:19.252374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:19.252580 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:19.252852 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:19.252855 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:19.252857 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:19.252944 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:19.253318 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:19.253321 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:19.253416 (+ 95us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.253538 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.253709 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":151,"threads_started":1}
I20260810 06:30:19.255545 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 06:30:19 dist-test-slave-7lbf krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:30:19 dist-test-slave-7lbf krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:19.284003 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.275714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44134 (local address 127.21.195.254:38025)
0810 06:30:19.275859 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.275862 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.275875 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:30:19.275919 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.275922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.275964 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.276031 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:19.276806 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.277359 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.278266 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.278537 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.278640 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.281052 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:19.281056 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:19.281058 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:19.281089 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:19.282547 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:19.282927 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:19.282930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:19.282932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:19.283007 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:19.283219 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:19.283221 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:19.283223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:19.283419 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:19.283522 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.283723 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.283834 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:30:19.287057 25079 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:19.290410 25079 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:19.306200 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.300626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35461 (local address 127.0.0.1:50078)
0810 06:30:19.301238 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.301251 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.301352 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.302128 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.302131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.302149 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:19.302273 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.302280 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.303660 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.303663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.304764 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.304775 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.305610 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.305614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.305729 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.305768 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.305895 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.306025 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":76,"thread_start_us":97,"threads_started":1}
I20260810 06:30:19.306188 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.300918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50078 (local address 127.21.195.193:35461)
0810 06:30:19.301202 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.301210 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.301466 (+ 256us) server_negotiation.cc:407] Connection header received
0810 06:30:19.301588 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.301595 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.301800 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.301967 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:19.302409 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.303555 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.304879 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.305468 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.305626 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.305790 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.305935 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.306048 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":97,"threads_started":1}
I20260810 06:30:19.306592 25947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.299814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:44097 (local address 127.0.0.1:59422)
0810 06:30:19.300665 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.300726 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.300867 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.301601 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.301608 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.301634 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:19.301818 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.301827 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.303111 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.303115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.304783 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.304797 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.306065 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.306070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.306201 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.306282 (+ 81us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.306357 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.306441 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":110,"thread_start_us":94,"threads_started":1}
I20260810 06:30:19.306917 25945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.300222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37499 (local address 127.0.0.1:39032)
0810 06:30:19.300933 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.300950 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.301055 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.302003 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.302006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.302024 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:19.302144 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.302151 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.303586 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.303590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.304826 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.304834 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.306066 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.306070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.306225 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.306629 (+ 404us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.306692 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.306783 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":387,"thread_start_us":113,"threads_started":1}
I20260810 06:30:19.307330 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.300022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59422 (local address 127.21.195.194:44097)
0810 06:30:19.300962 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.300979 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.301009 (+ 30us) server_negotiation.cc:407] Connection header received
0810 06:30:19.301101 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.301108 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.301365 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.301980 (+ 615us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:19.302139 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.302998 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.304957 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.305905 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.306818 (+ 913us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.306985 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.307049 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.307153 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":824,"thread_start_us":141,"threads_started":1}
I20260810 06:30:19.307742 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.300394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39032 (local address 127.21.195.195:37499)
0810 06:30:19.301499 (+ 1105us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.301511 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.301559 (+ 48us) server_negotiation.cc:407] Connection header received
0810 06:30:19.301636 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.301641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.301873 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.302029 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:19.302253 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.303466 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.305037 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.305905 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.307279 (+ 1374us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.307429 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.307488 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.307589 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":997,"thread_start_us":177,"threads_started":1}
I20260810 06:30:19.309837 25305 tablet_service.cc:1467] Processing CreateTablet for tablet 5b4f660e2683440498ded3d6de973e8e (DEFAULT_TABLE table=test-table [id=48dfafd641864bd3b6fd6d52baf52c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:19.310271 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 5b4f660e2683440498ded3d6de973e8e (DEFAULT_TABLE table=test-table [id=48dfafd641864bd3b6fd6d52baf52c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:19.310293 25547 tablet_service.cc:1467] Processing CreateTablet for tablet 5b4f660e2683440498ded3d6de973e8e (DEFAULT_TABLE table=test-table [id=48dfafd641864bd3b6fd6d52baf52c1f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:19.311167 25305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b4f660e2683440498ded3d6de973e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.311208 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b4f660e2683440498ded3d6de973e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.311299 25547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b4f660e2683440498ded3d6de973e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.318718 25952 tablet_bootstrap.cc:492] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: Bootstrap starting.
I20260810 06:30:19.320188 25953 tablet_bootstrap.cc:492] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: Bootstrap starting.
I20260810 06:30:19.321127 25952 tablet_bootstrap.cc:654] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.321892 25954 tablet_bootstrap.cc:492] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: Bootstrap starting.
I20260810 06:30:19.322256 25953 tablet_bootstrap.cc:654] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.322008 25952 log.cc:824] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:19.323154 25953 log.cc:824] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:19.324424 25954 tablet_bootstrap.cc:654] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.324671 25952 tablet_bootstrap.cc:492] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: No bootstrap required, opened a new log
I20260810 06:30:19.324895 25952 ts_tablet_manager.cc:1397] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:30:19.325297 25954 log.cc:824] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:19.325384 25953 tablet_bootstrap.cc:492] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: No bootstrap required, opened a new log
I20260810 06:30:19.325606 25953 ts_tablet_manager.cc:1397] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:30:19.327575 25954 tablet_bootstrap.cc:492] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: No bootstrap required, opened a new log
I20260810 06:30:19.327800 25954 ts_tablet_manager.cc:1397] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:30:19.329095 25952 raft_consensus.cc:348] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.329432 25952 raft_consensus.cc:374] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.329488 25952 raft_consensus.cc:729] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b79c43ac4a824fc5b7fd6f234b64b5cc, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.329419 25953 raft_consensus.cc:348] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.329706 25953 raft_consensus.cc:374] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.329759 25953 raft_consensus.cc:729] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6a71c0e0ec4999a271092b5aed5df9, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.330031 25952 consensus_queue.cc:260] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.330258 25953 consensus_queue.cc:260] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.331234 25953 ts_tablet_manager.cc:1428] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:30:19.331238 25952 ts_tablet_manager.cc:1428] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 06:30:19.331352 25419 heartbeater.cc:503] Master 127.21.195.254:38025 was elected leader, sending a full tablet report...
I20260810 06:30:19.331604 25908 heartbeater.cc:503] Master 127.21.195.254:38025 was elected leader, sending a full tablet report...
I20260810 06:30:19.333212 25954 raft_consensus.cc:348] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.333559 25954 raft_consensus.cc:374] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.333629 25954 raft_consensus.cc:729] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9488666d6f4f629fd26b1b9f308e62, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.334108 25954 consensus_queue.cc:260] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.335297 25954 ts_tablet_manager.cc:1428] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 06:30:19.335354 25653 heartbeater.cc:503] Master 127.21.195.254:38025 was elected leader, sending a full tablet report...
I20260810 06:30:19.380108 25960 raft_consensus.cc:482] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:19.380344 25960 raft_consensus.cc:504] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.381769 25960 leader_election.cc:288] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097), b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499)
I20260810 06:30:19.386515 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.382128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:55011 (local address 127.21.195.194:44097)
0810 06:30:19.382337 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.382342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.382434 (+ 92us) server_negotiation.cc:407] Connection header received
0810 06:30:19.382583 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.382586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.382640 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.382711 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:19.383057 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.383620 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.385342 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.385962 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.386092 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.386151 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.386306 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.386395 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260810 06:30:19.386548 25962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.381967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:44097 (local address 127.21.195.193:55011)
0810 06:30:19.382347 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.382361 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.382481 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.382732 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.382735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.382752 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:19.382941 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.382949 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.383744 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.383748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.385204 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.385217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.386091 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.386094 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.386175 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.386198 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.386276 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.386369 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":114,"thread_start_us":138,"threads_started":1}
I20260810 06:30:19.386729 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.382197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:53229 (local address 127.21.195.195:37499)
0810 06:30:19.382335 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.382340 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.382619 (+ 279us) server_negotiation.cc:407] Connection header received
0810 06:30:19.382703 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.382706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.382748 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.382811 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:19.383113 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.383672 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.385618 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.386192 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.386303 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.386348 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.386529 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.386605 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 06:30:19.386894 25963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.382061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37499 (local address 127.21.195.193:53229)
0810 06:30:19.382497 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.382508 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.382613 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.382832 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.382835 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.382851 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:19.383004 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.383009 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.383760 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.383762 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.385204 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.385217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.386314 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.386317 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.386411 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.386433 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.386504 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.386572 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":121,"thread_start_us":131,"threads_started":1}
I20260810 06:30:19.387334 25579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b4f660e2683440498ded3d6de973e8e" candidate_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62" is_pre_election: true
I20260810 06:30:19.387503 25832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b4f660e2683440498ded3d6de973e8e" candidate_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" is_pre_election: true
I20260810 06:30:19.387745 25579 raft_consensus.cc:2454] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6a71c0e0ec4999a271092b5aed5df9 in term 0.
I20260810 06:30:19.387744 25832 raft_consensus.cc:2454] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6a71c0e0ec4999a271092b5aed5df9 in term 0.
I20260810 06:30:19.388298 25226 leader_election.cc:302] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9488666d6f4f629fd26b1b9f308e62, 6b6a71c0e0ec4999a271092b5aed5df9; no voters:
I20260810 06:30:19.388587 25960 raft_consensus.cc:2781] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:19.388671 25960 raft_consensus.cc:482] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:19.388703 25960 raft_consensus.cc:3037] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.389825 25960 raft_consensus.cc:504] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.390208 25960 leader_election.cc:288] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [CANDIDATE]: Term 1 election: Requested vote from peers 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097), b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499)
I20260810 06:30:19.390568 25579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b4f660e2683440498ded3d6de973e8e" candidate_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62"
I20260810 06:30:19.390618 25832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b4f660e2683440498ded3d6de973e8e" candidate_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc"
I20260810 06:30:19.390699 25579 raft_consensus.cc:3037] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.390735 25832 raft_consensus.cc:3037] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.391829 25832 raft_consensus.cc:2454] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6a71c0e0ec4999a271092b5aed5df9 in term 1.
I20260810 06:30:19.391952 25579 raft_consensus.cc:2454] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6a71c0e0ec4999a271092b5aed5df9 in term 1.
I20260810 06:30:19.392174 25232 leader_election.cc:302] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a71c0e0ec4999a271092b5aed5df9, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:19.392362 25960 raft_consensus.cc:2781] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:19.392601 25960 raft_consensus.cc:686] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b6a71c0e0ec4999a271092b5aed5df9, State: Running, Role: LEADER
I20260810 06:30:19.392958 25960 consensus_queue.cc:237] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.396782 25081 catalog_manager.cc:5495] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } health_report { overall_health: UNKNOWN } } }
Aug 10 06:30:19 dist-test-slave-7lbf krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343418, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:19.460050 25972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.451472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:38025 (local address 127.0.0.1:44136)
0810 06:30:19.451788 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.451800 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.451940 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.452185 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.452187 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.452683 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:19.452792 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.452799 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.453584 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.453588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.454160 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.454168 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.454602 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.454606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.454686 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.455294 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:19.455307 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:19.456861 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:19.458585 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:19.458595 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:19.458602 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:19.458866 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:19.459088 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:19.459090 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:19.459092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:19.459166 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:19.459513 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:19.459520 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:19.459667 (+ 147us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.459759 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.459900 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":125,"threads_started":1}
I20260810 06:30:19.460083 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.451551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44136 (local address 127.21.195.254:38025)
0810 06:30:19.451697 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.451701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.451882 (+ 181us) server_negotiation.cc:407] Connection header received
0810 06:30:19.452029 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.452032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.452074 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.452143 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:19.452919 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.453452 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.454274 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.454493 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.454583 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.457008 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:19.457012 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:19.457014 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:19.457040 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:19.458473 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:19.458949 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:19.458951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:19.458952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:19.459027 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:19.459227 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:19.459228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:19.459229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:19.459411 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:19.459533 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.459809 (+ 276us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.459969 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":57}
I20260810 06:30:19.464572 25081 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:44136:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 06:30:19.465365 25081 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:19.470810 25547 tablet_service.cc:1467] Processing CreateTablet for tablet 59af974377474e96928ddbef65777b41 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b79398d7ea2b47ec87d9d86e60e6cca2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:19.470824 25305 tablet_service.cc:1467] Processing CreateTablet for tablet 59af974377474e96928ddbef65777b41 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b79398d7ea2b47ec87d9d86e60e6cca2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:19.471113 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 59af974377474e96928ddbef65777b41 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b79398d7ea2b47ec87d9d86e60e6cca2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:19.471642 25547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59af974377474e96928ddbef65777b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.471642 25305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59af974377474e96928ddbef65777b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.471685 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59af974377474e96928ddbef65777b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.474871 25954 tablet_bootstrap.cc:492] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: Bootstrap starting.
I20260810 06:30:19.474954 25953 tablet_bootstrap.cc:492] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: Bootstrap starting.
I20260810 06:30:19.475348 25952 tablet_bootstrap.cc:492] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: Bootstrap starting.
I20260810 06:30:19.475983 25954 tablet_bootstrap.cc:654] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.476097 25953 tablet_bootstrap.cc:654] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.476500 25952 tablet_bootstrap.cc:654] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.478291 25952 tablet_bootstrap.cc:492] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: No bootstrap required, opened a new log
I20260810 06:30:19.478341 25954 tablet_bootstrap.cc:492] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: No bootstrap required, opened a new log
I20260810 06:30:19.478404 25952 ts_tablet_manager.cc:1397] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:19.478420 25954 ts_tablet_manager.cc:1397] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 06:30:19.478544 25953 tablet_bootstrap.cc:492] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: No bootstrap required, opened a new log
I20260810 06:30:19.478631 25953 ts_tablet_manager.cc:1397] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 06:30:19.478933 25954 raft_consensus.cc:348] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.478933 25952 raft_consensus.cc:348] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.479076 25954 raft_consensus.cc:374] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.479076 25952 raft_consensus.cc:374] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.479115 25954 raft_consensus.cc:729] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9488666d6f4f629fd26b1b9f308e62, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.479115 25952 raft_consensus.cc:729] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b79c43ac4a824fc5b7fd6f234b64b5cc, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.479051 25953 raft_consensus.cc:348] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.479164 25953 raft_consensus.cc:374] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.479192 25953 raft_consensus.cc:729] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6a71c0e0ec4999a271092b5aed5df9, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.479276 25954 consensus_queue.cc:260] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.479319 25953 consensus_queue.cc:260] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.479583 25953 ts_tablet_manager.cc:1428] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:19.479579 25961 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.479768 25961 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:19.479736 25960 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.479868 25960 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:19.479590 25954 ts_tablet_manager.cc:1428] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 06:30:19.479344 25952 consensus_queue.cc:260] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.480311 25952 ts_tablet_manager.cc:1428] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:30:19.480365 25959 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.480511 25959 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 06:30:19.487056 25659 tablet.cc:2369] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:19.489630 25910 tablet.cc:2369] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:19.493682 25420 tablet.cc:2369] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:30:19.557924 25959 raft_consensus.cc:482] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:19.558096 25959 raft_consensus.cc:504] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.559340 25959 leader_election.cc:288] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461), 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097)
I20260810 06:30:19.563105 25730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.559626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35461 (local address 127.21.195.195:33009)
0810 06:30:19.559775 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.559791 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.559915 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.560170 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.560173 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.560190 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:19.560315 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.560320 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.561072 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.561075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.561973 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.561983 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.562670 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.562674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.562783 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.562804 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.562878 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.562956 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 06:30:19.563104 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.559742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:33009 (local address 127.21.195.193:35461)
0810 06:30:19.559878 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.559884 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.559900 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:30:19.560027 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.560031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.560076 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.560141 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:19.560428 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.560957 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.562107 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.562553 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.562670 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.562730 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.562910 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.562988 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:30:19.563488 25946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.560095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:34455 (local address 127.21.195.194:44097)
0810 06:30:19.560220 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.560225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.560483 (+ 258us) server_negotiation.cc:407] Connection header received
0810 06:30:19.560586 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.560588 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.560631 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.560695 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:19.560977 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.561456 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.562496 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.562898 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.563006 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.563059 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.563264 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.563365 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:30:19.563874 25982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.559953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:44097 (local address 127.21.195.195:34455)
0810 06:30:19.560382 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.560394 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.560491 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.560721 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.560724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.560739 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:19.560868 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.560873 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.561589 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.561593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.562369 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.562378 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.563020 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.563023 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.563117 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.563137 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.563654 (+ 517us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.563735 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":120,"threads_started":1}
I20260810 06:30:19.563808 25340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59af974377474e96928ddbef65777b41" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" is_pre_election: true
I20260810 06:30:19.564112 25340 raft_consensus.cc:2454] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 0.
I20260810 06:30:19.564354 25579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59af974377474e96928ddbef65777b41" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62" is_pre_election: true
I20260810 06:30:19.564517 25579 raft_consensus.cc:2454] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 0.
I20260810 06:30:19.564651 25706 leader_election.cc:302] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a71c0e0ec4999a271092b5aed5df9, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:19.564993 25959 raft_consensus.cc:2781] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:19.565053 25959 raft_consensus.cc:482] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:19.565078 25959 raft_consensus.cc:3037] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.566219 25959 raft_consensus.cc:504] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.566576 25959 leader_election.cc:288] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 election: Requested vote from peers 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461), 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097)
I20260810 06:30:19.566908 25340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59af974377474e96928ddbef65777b41" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6a71c0e0ec4999a271092b5aed5df9"
I20260810 06:30:19.567044 25340 raft_consensus.cc:3037] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.567039 25579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59af974377474e96928ddbef65777b41" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62"
I20260810 06:30:19.567160 25579 raft_consensus.cc:3037] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.568260 25340 raft_consensus.cc:2454] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 1.
I20260810 06:30:19.568260 25579 raft_consensus.cc:2454] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 1.
I20260810 06:30:19.568547 25706 leader_election.cc:302] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a71c0e0ec4999a271092b5aed5df9, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:19.568712 25959 raft_consensus.cc:2781] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:19.568953 25959 raft_consensus.cc:686] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 LEADER]: Becoming Leader. State: Replica: b79c43ac4a824fc5b7fd6f234b64b5cc, State: Running, Role: LEADER
I20260810 06:30:19.569305 25959 consensus_queue.cc:237] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.571839 25985 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: TxnStatusTablet state changed. Reason: New leader b79c43ac4a824fc5b7fd6f234b64b5cc. Latest consensus state: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.571966 25985 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:19.572324 25987 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 06:30:19.572546 25987 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 06:30:19.573467 25079 catalog_manager.cc:5495] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc reported cstate change: term changed from 0 to 1, leader changed from <none> to b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195). New cstate: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260810 06:30:19.609319 25972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.604943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37499 (local address 127.0.0.1:39044)
0810 06:30:19.605239 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.605253 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.605363 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.605751 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.605753 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.605760 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:19.605875 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.605880 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.606890 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.606892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.607502 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.607509 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.608073 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.608075 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.608140 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.608193 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.609055 (+ 862us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.609064 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.609103 (+ 39us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.609189 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181}
I20260810 06:30:19.609357 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.605118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39044 (local address 127.21.195.195:37499)
0810 06:30:19.605286 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.605291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.605308 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:30:19.605547 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.605551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.605629 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.605745 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:19.605977 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.606766 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.607611 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.607972 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.608076 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.608330 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.608974 (+ 644us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.609095 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.609126 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.609192 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:19.615211 25340 raft_consensus.cc:1261] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Refusing update from remote peer b79c43ac4a824fc5b7fd6f234b64b5cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:19.615213 25579 raft_consensus.cc:1261] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Refusing update from remote peer b79c43ac4a824fc5b7fd6f234b64b5cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:19.615921 25959 consensus_queue.cc:1035] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:19.616127 25985 consensus_queue.cc:1035] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:19.619544 25960 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: TxnStatusTablet state changed. Reason: New leader b79c43ac4a824fc5b7fd6f234b64b5cc. Latest consensus state: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.619686 25960 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:19.622151 25985 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.622285 25985 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:19.622303 25960 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.622421 25960 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P 6b6a71c0e0ec4999a271092b5aed5df9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:19.622400 25994 mvcc.cc:205] Tried to move back new op lower bound from 7316862646735568896 to 7316862646559043584. Current Snapshot: MvccSnapshot[applied={T|T < 7316862646735568896}]
I20260810 06:30:19.624646 25997 mvcc.cc:205] Tried to move back new op lower bound from 7316862646735568896 to 7316862646559043584. Current Snapshot: MvccSnapshot[applied={T|T < 7316862646735568896}]
I20260810 06:30:19.627080 25961 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: TxnStatusTablet state changed. Reason: New leader b79c43ac4a824fc5b7fd6f234b64b5cc. Latest consensus state: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.627240 25961 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:19.631019 25959 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.631160 25959 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P b79c43ac4a824fc5b7fd6f234b64b5cc: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:19.632547 25995 mvcc.cc:205] Tried to move back new op lower bound from 7316862646735568896 to 7316862646559043584. Current Snapshot: MvccSnapshot[applied={T|T < 7316862646735568896}]
I20260810 06:30:19.632851 25961 tablet_replica.cc:439] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } } }
I20260810 06:30:19.632970 25961 tablet_replica.cc:442] T 59af974377474e96928ddbef65777b41 P 1b9488666d6f4f629fd26b1b9f308e62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:19.635929 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.630637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50082 (local address 127.21.195.193:35461)
0810 06:30:19.630759 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.630763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.630780 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:30:19.630866 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.630869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.630934 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.631054 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:19.631438 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.632254 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.633596 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.633942 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.634049 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.634481 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.635118 (+ 637us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.635228 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.635721 (+ 493us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.635785 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:30:19.648263 26010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.644009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37499 (local address 127.21.195.193:52397)
0810 06:30:19.644463 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.644476 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.644573 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.644815 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.644817 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.644822 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:19.644963 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.644969 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.646048 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.646051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.646805 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.646816 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.647429 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.647431 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.647529 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.647585 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.647974 (+ 389us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.647979 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.648024 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.648100 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":143,"threads_started":1}
I20260810 06:30:19.648283 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.644142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:52397 (local address 127.21.195.195:37499)
0810 06:30:19.644281 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.644286 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.644541 (+ 255us) server_negotiation.cc:407] Connection header received
0810 06:30:19.644665 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.644668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.644724 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.644813 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:19.645061 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.645937 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.646936 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.647326 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.647427 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.647788 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.647881 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.647921 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.648076 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.648144 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:30:19.656374 25579 raft_consensus.cc:1261] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Refusing update from remote peer 6b6a71c0e0ec4999a271092b5aed5df9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:19.656473 25832 raft_consensus.cc:1261] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Refusing update from remote peer 6b6a71c0e0ec4999a271092b5aed5df9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:19.656951 25965 consensus_queue.cc:1035] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:19.657179 25960 consensus_queue.cc:1035] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:19.681741 25921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.678006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35461 (local address 127.21.195.195:58437)
0810 06:30:19.678344 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.678359 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.678460 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.678693 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.678696 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.678705 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:19.678811 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.678817 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.679862 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.679866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.680502 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.680511 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.680965 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.680968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.681062 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.681112 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.681398 (+ 286us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.681405 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.681477 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.681596 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203}
I20260810 06:30:19.682349 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.678249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:58437 (local address 127.21.195.193:35461)
0810 06:30:19.678369 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.678372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.678405 (+ 33us) server_negotiation.cc:407] Connection header received
0810 06:30:19.678549 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.678552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.678597 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.678664 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:19.678924 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.679632 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.680627 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.680865 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.680956 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.681242 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.681324 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.681382 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.682142 (+ 760us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.682209 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 06:30:19.712325 25078 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:19.712575 25078 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:19.715840 25078 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: Sending DeleteTablet for 3 replicas of tablet 5b4f660e2683440498ded3d6de973e8e
I20260810 06:30:19.716876 25547 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b4f660e2683440498ded3d6de973e8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:19 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:59422
I20260810 06:30:19.717554 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b4f660e2683440498ded3d6de973e8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:19 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:39032
I20260810 06:30:19.717958 25305 tablet_service.cc:1514] Processing DeleteTablet for tablet 5b4f660e2683440498ded3d6de973e8e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:19 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50078
I20260810 06:30:19.718432 25078 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 06:30:19.718799 26021 tablet_replica.cc:330] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: stopping tablet replica
W20260810 06:30:19.718943 25078 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:19.719316 26021 raft_consensus.cc:2229] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:19.719698 26021 raft_consensus.cc:2258] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:19.721733 26021 ts_tablet_manager.cc:1905] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:19.724691 25305 tablet_service.cc:1467] Processing CreateTablet for tablet 1ab9a992aa2d43f08b425d761da0667a (DEFAULT_TABLE table=test-table [id=fa59cd8ad9fa4f0cbd858fd3d3308c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:19.725034 25305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ab9a992aa2d43f08b425d761da0667a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.725569 26022 tablet_replica.cc:330] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: stopping tablet replica
I20260810 06:30:19.725739 26023 tablet_replica.cc:330] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: stopping tablet replica
I20260810 06:30:19.725950 26022 raft_consensus.cc:2229] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:19.725977 26021 ts_tablet_manager.cc:1918] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:19.726142 26023 raft_consensus.cc:2229] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:19.726159 26022 raft_consensus.cc:2258] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:19.726190 26021 log.cc:1196] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/5b4f660e2683440498ded3d6de973e8e
I20260810 06:30:19.726753 26021 ts_tablet_manager.cc:1939] T 5b4f660e2683440498ded3d6de973e8e P 1b9488666d6f4f629fd26b1b9f308e62: Deleting consensus metadata
I20260810 06:30:19.726773 26023 raft_consensus.cc:2258] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:19.727689 25953 tablet_bootstrap.cc:492] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: Bootstrap starting.
I20260810 06:30:19.728111 25547 tablet_service.cc:1467] Processing CreateTablet for tablet 1ab9a992aa2d43f08b425d761da0667a (DEFAULT_TABLE table=test-table [id=fa59cd8ad9fa4f0cbd858fd3d3308c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:19.728392 25547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ab9a992aa2d43f08b425d761da0667a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.728497 26023 ts_tablet_manager.cc:1905] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:19.728732 25953 tablet_bootstrap.cc:654] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.730815 25954 tablet_bootstrap.cc:492] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: Bootstrap starting.
I20260810 06:30:19.731261 25053 catalog_manager.cc:4841] TS 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097): tablet 5b4f660e2683440498ded3d6de973e8e (table test-table [id=48dfafd641864bd3b6fd6d52baf52c1f]) successfully deleted
I20260810 06:30:19.731992 25954 tablet_bootstrap.cc:654] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.732795 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 1ab9a992aa2d43f08b425d761da0667a (DEFAULT_TABLE table=test-table [id=fa59cd8ad9fa4f0cbd858fd3d3308c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:19.733124 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ab9a992aa2d43f08b425d761da0667a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:19.733247 26022 ts_tablet_manager.cc:1905] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:19.733779 26023 ts_tablet_manager.cc:1918] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:19.733909 26023 log.cc:1196] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/5b4f660e2683440498ded3d6de973e8e
I20260810 06:30:19.734259 26023 ts_tablet_manager.cc:1939] T 5b4f660e2683440498ded3d6de973e8e P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting consensus metadata
I20260810 06:30:19.735658 25053 catalog_manager.cc:4841] TS 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461): tablet 5b4f660e2683440498ded3d6de973e8e (table test-table [id=48dfafd641864bd3b6fd6d52baf52c1f]) successfully deleted
I20260810 06:30:19.736215 25952 tablet_bootstrap.cc:492] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: Bootstrap starting.
I20260810 06:30:19.736351 26022 ts_tablet_manager.cc:1918] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:19.736474 26022 log.cc:1196] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/5b4f660e2683440498ded3d6de973e8e
I20260810 06:30:19.736850 26022 ts_tablet_manager.cc:1939] T 5b4f660e2683440498ded3d6de973e8e P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting consensus metadata
I20260810 06:30:19.737260 25952 tablet_bootstrap.cc:654] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:19.738345 25054 catalog_manager.cc:4841] TS b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499): tablet 5b4f660e2683440498ded3d6de973e8e (table test-table [id=48dfafd641864bd3b6fd6d52baf52c1f]) successfully deleted
I20260810 06:30:19.739125 25952 tablet_bootstrap.cc:492] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: No bootstrap required, opened a new log
I20260810 06:30:19.739228 25952 ts_tablet_manager.cc:1397] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:19.739662 25952 raft_consensus.cc:348] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.739805 25952 raft_consensus.cc:374] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.739845 25952 raft_consensus.cc:729] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b79c43ac4a824fc5b7fd6f234b64b5cc, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.740037 25952 consensus_queue.cc:260] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.740921 25952 ts_tablet_manager.cc:1428] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:30:19.742910 25953 tablet_bootstrap.cc:492] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: No bootstrap required, opened a new log
I20260810 06:30:19.743042 25953 ts_tablet_manager.cc:1397] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260810 06:30:19.743626 25953 raft_consensus.cc:348] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.743775 25953 raft_consensus.cc:374] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.743818 25953 raft_consensus.cc:729] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6a71c0e0ec4999a271092b5aed5df9, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.743983 25953 consensus_queue.cc:260] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.744333 25953 ts_tablet_manager.cc:1428] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:19.748453 25954 tablet_bootstrap.cc:492] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: No bootstrap required, opened a new log
I20260810 06:30:19.748610 25954 ts_tablet_manager.cc:1397] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260810 06:30:19.749224 25959 raft_consensus.cc:482] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:19.749220 25954 raft_consensus.cc:348] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.749358 25954 raft_consensus.cc:374] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:19.749326 25959 raft_consensus.cc:504] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.749394 25954 raft_consensus.cc:729] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9488666d6f4f629fd26b1b9f308e62, State: Initialized, Role: FOLLOWER
I20260810 06:30:19.749609 25954 consensus_queue.cc:260] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.749732 25959 leader_election.cc:288] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461), 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097)
I20260810 06:30:19.749935 25954 ts_tablet_manager.cc:1428] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260810 06:30:19.750237 25340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ab9a992aa2d43f08b425d761da0667a" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" is_pre_election: true
I20260810 06:30:19.750407 25340 raft_consensus.cc:2454] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 0.
I20260810 06:30:19.750813 25706 leader_election.cc:302] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a71c0e0ec4999a271092b5aed5df9, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:19.750821 25579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ab9a992aa2d43f08b425d761da0667a" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62" is_pre_election: true
I20260810 06:30:19.750952 25579 raft_consensus.cc:2454] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 0.
I20260810 06:30:19.751012 25959 raft_consensus.cc:2781] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:19.751071 25959 raft_consensus.cc:482] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:19.751114 25959 raft_consensus.cc:3037] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.752306 25959 raft_consensus.cc:504] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.752698 25959 leader_election.cc:288] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 election: Requested vote from peers 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461), 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097)
I20260810 06:30:19.753633 25340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ab9a992aa2d43f08b425d761da0667a" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6a71c0e0ec4999a271092b5aed5df9"
I20260810 06:30:19.753667 25579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ab9a992aa2d43f08b425d761da0667a" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62"
I20260810 06:30:19.753762 25340 raft_consensus.cc:3037] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.753806 25579 raft_consensus.cc:3037] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:19.754938 25340 raft_consensus.cc:2454] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 1.
I20260810 06:30:19.755069 25579 raft_consensus.cc:2454] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 1.
I20260810 06:30:19.755280 25706 leader_election.cc:302] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a71c0e0ec4999a271092b5aed5df9, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:19.755602 25959 raft_consensus.cc:2781] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:19.755686 25959 raft_consensus.cc:686] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 LEADER]: Becoming Leader. State: Replica: b79c43ac4a824fc5b7fd6f234b64b5cc, State: Running, Role: LEADER
I20260810 06:30:19.755817 25959 consensus_queue.cc:237] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:19.757697 25078 catalog_manager.cc:5495] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc reported cstate change: term changed from 0 to 1, leader changed from <none> to b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195). New cstate: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260810 06:30:19.777683 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.773561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39048 (local address 127.21.195.195:37499)
0810 06:30:19.773736 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.773741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.774385 (+ 644us) server_negotiation.cc:407] Connection header received
0810 06:30:19.774443 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.774446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.774508 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.774577 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:19.774859 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.775370 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.776601 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.776835 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.776928 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.777211 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.777288 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.777336 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.777455 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.777509 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 06:30:19.787449 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.784437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:47137 (local address 127.21.195.195:37499)
0810 06:30:19.784525 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:19.784530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:19.784599 (+ 69us) server_negotiation.cc:407] Connection header received
0810 06:30:19.784717 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:19.784720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:19.784759 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:19.784817 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:19.785063 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.785615 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.786456 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.786666 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.786754 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.786974 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.787046 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.787103 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:19.787190 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 06:30:19.787266 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":39}
I20260810 06:30:19.787449 25921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:19.784392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37499 (local address 127.21.195.195:47137)
0810 06:30:19.784527 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:19.784542 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:19.784636 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:19.784832 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:19.784835 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:19.784841 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:19.784976 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.784982 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.785710 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.785714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.786341 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:19.786352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:19.786763 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:19.786766 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:19.786847 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:19.786873 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:19.787120 (+ 247us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:19.787126 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:30:19.787183 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 06:30:19.787303 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":51}
I20260810 06:30:19.794463 25579 raft_consensus.cc:1261] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Refusing update from remote peer b79c43ac4a824fc5b7fd6f234b64b5cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:19.794463 25340 raft_consensus.cc:1261] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Refusing update from remote peer b79c43ac4a824fc5b7fd6f234b64b5cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:19.794925 25959 consensus_queue.cc:1035] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:19.795277 25985 consensus_queue.cc:1035] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 06:30:19.812486 25994 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 06:30:21.375087 25079 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:21.375255 25079 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:21.377959 25079 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: Sending DeleteTablet for 3 replicas of tablet 1ab9a992aa2d43f08b425d761da0667a
I20260810 06:30:21.378571 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ab9a992aa2d43f08b425d761da0667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:21 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:39032
I20260810 06:30:21.378626 25547 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ab9a992aa2d43f08b425d761da0667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:21 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:59422
I20260810 06:30:21.378690 25305 tablet_service.cc:1514] Processing DeleteTablet for tablet 1ab9a992aa2d43f08b425d761da0667a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:21 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50078
I20260810 06:30:21.378998 26060 tablet_replica.cc:330] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: stopping tablet replica
I20260810 06:30:21.379142 26060 raft_consensus.cc:2229] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:21.379521 26060 raft_consensus.cc:2258] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:21.379786 26061 tablet_replica.cc:330] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: stopping tablet replica
I20260810 06:30:21.379911 26061 raft_consensus.cc:2229] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:21.380031 26061 raft_consensus.cc:2258] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:21.380681 26061 ts_tablet_manager.cc:1905] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:21.383407 26064 tablet_replica.cc:330] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: stopping tablet replica
I20260810 06:30:21.383558 26064 raft_consensus.cc:2229] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:21.383701 26064 raft_consensus.cc:2258] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:21.383818 26060 ts_tablet_manager.cc:1905] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:21.383867 26061 ts_tablet_manager.cc:1918] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:30:21.383967 26061 log.cc:1196] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/1ab9a992aa2d43f08b425d761da0667a
I20260810 06:30:21.384246 26061 ts_tablet_manager.cc:1939] T 1ab9a992aa2d43f08b425d761da0667a P 1b9488666d6f4f629fd26b1b9f308e62: Deleting consensus metadata
I20260810 06:30:21.384406 26064 ts_tablet_manager.cc:1905] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:21.385015 25053 catalog_manager.cc:4841] TS 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097): tablet 1ab9a992aa2d43f08b425d761da0667a (table test-table [id=fa59cd8ad9fa4f0cbd858fd3d3308c47]) successfully deleted
I20260810 06:30:21.386873 26064 ts_tablet_manager.cc:1918] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:30:21.386965 26064 log.cc:1196] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/1ab9a992aa2d43f08b425d761da0667a
I20260810 06:30:21.387217 26064 ts_tablet_manager.cc:1939] T 1ab9a992aa2d43f08b425d761da0667a P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting consensus metadata
I20260810 06:30:21.387806 26060 ts_tablet_manager.cc:1918] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:30:21.387892 26060 log.cc:1196] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/1ab9a992aa2d43f08b425d761da0667a
I20260810 06:30:21.388026 25053 catalog_manager.cc:4841] TS 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461): tablet 1ab9a992aa2d43f08b425d761da0667a (table test-table [id=fa59cd8ad9fa4f0cbd858fd3d3308c47]) successfully deleted
I20260810 06:30:21.388202 26060 ts_tablet_manager.cc:1939] T 1ab9a992aa2d43f08b425d761da0667a P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting consensus metadata
I20260810 06:30:21.388916 25054 catalog_manager.cc:4841] TS b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499): tablet 1ab9a992aa2d43f08b425d761da0667a (table test-table [id=fa59cd8ad9fa4f0cbd858fd3d3308c47]) successfully deleted
Aug 10 06:30:21 dist-test-slave-7lbf krb5kdc[25004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343421, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:30:21 dist-test-slave-7lbf krb5kdc[25004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343421, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:21.409742 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:21.400869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44152 (local address 127.21.195.254:38025)
0810 06:30:21.401189 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:21.401217 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:21.401234 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:30:21.401390 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:21.401394 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:21.401449 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:21.401599 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:21.402350 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:21.402928 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:21.403791 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:21.404042 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:21.404172 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:21.406735 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:21.406738 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:21.406740 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:21.406768 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:21.408199 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:21.408660 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:21.408662 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:21.408663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:21.408736 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:21.408955 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:21.408957 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:21.408958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:21.409135 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:21.409235 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:21.409445 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 06:30:21.409589 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":121,"threads_started":1}
I20260810 06:30:21.412494 25079 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:21.413012 25079 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:21.417945 25305 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb51424d97c489ab52edf3de15266cf (DEFAULT_TABLE table=test-table [id=25efdd0975424cc292af92bd22597a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:21.418022 25547 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb51424d97c489ab52edf3de15266cf (DEFAULT_TABLE table=test-table [id=25efdd0975424cc292af92bd22597a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:21.418145 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 1fb51424d97c489ab52edf3de15266cf (DEFAULT_TABLE table=test-table [id=25efdd0975424cc292af92bd22597a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:21.418313 25305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb51424d97c489ab52edf3de15266cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:21.418331 25547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb51424d97c489ab52edf3de15266cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:21.418422 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fb51424d97c489ab52edf3de15266cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:21.420446 26080 tablet_bootstrap.cc:492] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: Bootstrap starting.
I20260810 06:30:21.421247 26081 tablet_bootstrap.cc:492] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: Bootstrap starting.
I20260810 06:30:21.421826 26080 tablet_bootstrap.cc:654] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:21.422258 26081 tablet_bootstrap.cc:654] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:21.422637 26083 tablet_bootstrap.cc:492] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: Bootstrap starting.
I20260810 06:30:21.423082 26080 tablet_bootstrap.cc:492] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: No bootstrap required, opened a new log
I20260810 06:30:21.423193 26080 ts_tablet_manager.cc:1397] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:21.423520 26081 tablet_bootstrap.cc:492] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: No bootstrap required, opened a new log
I20260810 06:30:21.423615 26081 ts_tablet_manager.cc:1397] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:30:21.423604 26080 raft_consensus.cc:348] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.423728 26080 raft_consensus.cc:374] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:21.423749 26083 tablet_bootstrap.cc:654] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:21.423767 26080 raft_consensus.cc:729] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9488666d6f4f629fd26b1b9f308e62, State: Initialized, Role: FOLLOWER
I20260810 06:30:21.423903 26080 consensus_queue.cc:260] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.424043 26081 raft_consensus.cc:348] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.424178 26081 raft_consensus.cc:374] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:21.424224 26081 raft_consensus.cc:729] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6a71c0e0ec4999a271092b5aed5df9, State: Initialized, Role: FOLLOWER
I20260810 06:30:21.424300 26080 ts_tablet_manager.cc:1428] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:21.424388 26081 consensus_queue.cc:260] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.424757 26081 ts_tablet_manager.cc:1428] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:21.425767 26083 tablet_bootstrap.cc:492] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: No bootstrap required, opened a new log
I20260810 06:30:21.425911 26083 ts_tablet_manager.cc:1397] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260810 06:30:21.426400 26083 raft_consensus.cc:348] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.426498 26083 raft_consensus.cc:374] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:21.426519 26083 raft_consensus.cc:729] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b79c43ac4a824fc5b7fd6f234b64b5cc, State: Initialized, Role: FOLLOWER
I20260810 06:30:21.426615 26083 consensus_queue.cc:260] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.426939 26083 ts_tablet_manager.cc:1428] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:30:21.440091 26095 raft_consensus.cc:482] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:21.440285 26095 raft_consensus.cc:504] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.440780 26095 leader_election.cc:288] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097), b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499)
I20260810 06:30:21.441233 25832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fb51424d97c489ab52edf3de15266cf" candidate_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" is_pre_election: true
I20260810 06:30:21.441237 25581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fb51424d97c489ab52edf3de15266cf" candidate_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62" is_pre_election: true
I20260810 06:30:21.441387 25832 raft_consensus.cc:2454] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6a71c0e0ec4999a271092b5aed5df9 in term 0.
I20260810 06:30:21.441417 25581 raft_consensus.cc:2454] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6a71c0e0ec4999a271092b5aed5df9 in term 0.
I20260810 06:30:21.441757 25232 leader_election.cc:302] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a71c0e0ec4999a271092b5aed5df9, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:21.441948 26095 raft_consensus.cc:2781] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:21.442013 26095 raft_consensus.cc:482] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:21.442055 26095 raft_consensus.cc:3037] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:21.443095 26095 raft_consensus.cc:504] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.443452 26095 leader_election.cc:288] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [CANDIDATE]: Term 1 election: Requested vote from peers 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097), b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499)
I20260810 06:30:21.443873 25581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fb51424d97c489ab52edf3de15266cf" candidate_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62"
I20260810 06:30:21.443873 25832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fb51424d97c489ab52edf3de15266cf" candidate_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc"
I20260810 06:30:21.444025 25832 raft_consensus.cc:3037] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:21.444017 25581 raft_consensus.cc:3037] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:21.445348 25581 raft_consensus.cc:2454] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6a71c0e0ec4999a271092b5aed5df9 in term 1.
I20260810 06:30:21.445349 25832 raft_consensus.cc:2454] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6a71c0e0ec4999a271092b5aed5df9 in term 1.
I20260810 06:30:21.445724 25232 leader_election.cc:302] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6a71c0e0ec4999a271092b5aed5df9, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:21.445935 26095 raft_consensus.cc:2781] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:21.446177 26095 raft_consensus.cc:686] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 LEADER]: Becoming Leader. State: Replica: 6b6a71c0e0ec4999a271092b5aed5df9, State: Running, Role: LEADER
I20260810 06:30:21.446336 26095 consensus_queue.cc:237] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.450639 25079 catalog_manager.cc:5495] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260810 06:30:21.466289 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:21.463260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50094 (local address 127.21.195.193:35461)
0810 06:30:21.463532 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:21.463539 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:21.463551 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:30:21.463594 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:21.463596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:21.463639 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:21.463713 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:21.463914 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:21.464452 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:21.465241 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:21.465467 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:21.465582 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:21.465871 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:21.465955 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:21.466005 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:21.466078 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 06:30:21.466128 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":116,"threads_started":1}
I20260810 06:30:21.473152 25832 raft_consensus.cc:1261] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Refusing update from remote peer 6b6a71c0e0ec4999a271092b5aed5df9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:21.473270 25581 raft_consensus.cc:1261] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Refusing update from remote peer 6b6a71c0e0ec4999a271092b5aed5df9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:21.473652 26095 consensus_queue.cc:1035] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:21.473824 26096 consensus_queue.cc:1035] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:21.507504 25079 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:21.507678 25079 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:21.509788 25079 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: Sending DeleteTablet for 3 replicas of tablet 1fb51424d97c489ab52edf3de15266cf
I20260810 06:30:21.510339 25305 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fb51424d97c489ab52edf3de15266cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:21 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50078
I20260810 06:30:21.510457 25794 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fb51424d97c489ab52edf3de15266cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:21 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:39032
I20260810 06:30:21.510486 25547 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fb51424d97c489ab52edf3de15266cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:21 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:59422
I20260810 06:30:21.510708 26064 tablet_replica.cc:330] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: stopping tablet replica
I20260810 06:30:21.510713 26061 tablet_replica.cc:330] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: stopping tablet replica
I20260810 06:30:21.510842 26064 raft_consensus.cc:2229] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:21.510847 26061 raft_consensus.cc:2229] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:21.510893 26060 tablet_replica.cc:330] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: stopping tablet replica
I20260810 06:30:21.510998 26061 raft_consensus.cc:2258] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:21.511015 26060 raft_consensus.cc:2229] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:21.511085 26064 raft_consensus.cc:2258] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:21.511128 26060 raft_consensus.cc:2258] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:21.511317 25079 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:21.511791 25079 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:21.511878 26064 ts_tablet_manager.cc:1905] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:21.511916 26060 ts_tablet_manager.cc:1905] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:21.511999 26061 ts_tablet_manager.cc:1905] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:21.514487 26060 ts_tablet_manager.cc:1918] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:21.514550 26060 log.cc:1196] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/1fb51424d97c489ab52edf3de15266cf
I20260810 06:30:21.514670 26061 ts_tablet_manager.cc:1918] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:21.514670 26064 ts_tablet_manager.cc:1918] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:21.514744 26060 ts_tablet_manager.cc:1939] T 1fb51424d97c489ab52edf3de15266cf P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting consensus metadata
I20260810 06:30:21.514742 26064 log.cc:1196] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/1fb51424d97c489ab52edf3de15266cf
I20260810 06:30:21.514742 26061 log.cc:1196] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/1fb51424d97c489ab52edf3de15266cf
I20260810 06:30:21.514995 26061 ts_tablet_manager.cc:1939] T 1fb51424d97c489ab52edf3de15266cf P 1b9488666d6f4f629fd26b1b9f308e62: Deleting consensus metadata
I20260810 06:30:21.515009 26064 ts_tablet_manager.cc:1939] T 1fb51424d97c489ab52edf3de15266cf P 6b6a71c0e0ec4999a271092b5aed5df9: Deleting consensus metadata
I20260810 06:30:21.515461 25054 catalog_manager.cc:4841] TS b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499): tablet 1fb51424d97c489ab52edf3de15266cf (table test-table [id=25efdd0975424cc292af92bd22597a33]) successfully deleted
I20260810 06:30:21.515775 25053 catalog_manager.cc:4841] TS 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461): tablet 1fb51424d97c489ab52edf3de15266cf (table test-table [id=25efdd0975424cc292af92bd22597a33]) successfully deleted
I20260810 06:30:21.515919 25053 catalog_manager.cc:4841] TS 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097): tablet 1fb51424d97c489ab52edf3de15266cf (table test-table [id=25efdd0975424cc292af92bd22597a33]) successfully deleted
I20260810 06:30:21.519425 25305 tablet_service.cc:1467] Processing CreateTablet for tablet 7978974cbf344c7886744632943d3379 (DEFAULT_TABLE table=test-table [id=4c39451e5bd440b79d8e060e9e23ce4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:21.519472 25547 tablet_service.cc:1467] Processing CreateTablet for tablet 7978974cbf344c7886744632943d3379 (DEFAULT_TABLE table=test-table [id=4c39451e5bd440b79d8e060e9e23ce4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:21.519521 25794 tablet_service.cc:1467] Processing CreateTablet for tablet 7978974cbf344c7886744632943d3379 (DEFAULT_TABLE table=test-table [id=4c39451e5bd440b79d8e060e9e23ce4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:21.519729 25305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7978974cbf344c7886744632943d3379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:21.519729 25547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7978974cbf344c7886744632943d3379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:21.519820 25794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7978974cbf344c7886744632943d3379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:21.521870 26083 tablet_bootstrap.cc:492] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: Bootstrap starting.
I20260810 06:30:21.522084 26081 tablet_bootstrap.cc:492] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9: Bootstrap starting.
I20260810 06:30:21.522084 26080 tablet_bootstrap.cc:492] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: Bootstrap starting.
I20260810 06:30:21.522681 26083 tablet_bootstrap.cc:654] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:21.522882 26081 tablet_bootstrap.cc:654] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:21.522979 26080 tablet_bootstrap.cc:654] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:21.523747 26083 tablet_bootstrap.cc:492] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: No bootstrap required, opened a new log
I20260810 06:30:21.523837 26083 ts_tablet_manager.cc:1397] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 06:30:21.524223 26080 tablet_bootstrap.cc:492] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: No bootstrap required, opened a new log
I20260810 06:30:21.524225 26083 raft_consensus.cc:348] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.524317 26080 ts_tablet_manager.cc:1397] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:30:21.524338 26083 raft_consensus.cc:374] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:21.524374 26083 raft_consensus.cc:729] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b79c43ac4a824fc5b7fd6f234b64b5cc, State: Initialized, Role: FOLLOWER
I20260810 06:30:21.524442 26081 tablet_bootstrap.cc:492] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9: No bootstrap required, opened a new log
I20260810 06:30:21.524498 26083 consensus_queue.cc:260] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.524544 26081 ts_tablet_manager.cc:1397] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 06:30:21.524755 26083 ts_tablet_manager.cc:1428] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:30:21.524933 26081 raft_consensus.cc:348] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.524959 26080 raft_consensus.cc:348] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.525066 26080 raft_consensus.cc:374] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:21.525066 26081 raft_consensus.cc:374] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:21.525099 26081 raft_consensus.cc:729] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6a71c0e0ec4999a271092b5aed5df9, State: Initialized, Role: FOLLOWER
I20260810 06:30:21.525099 26080 raft_consensus.cc:729] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b9488666d6f4f629fd26b1b9f308e62, State: Initialized, Role: FOLLOWER
I20260810 06:30:21.525220 26081 consensus_queue.cc:260] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.525220 26080 consensus_queue.cc:260] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.525483 26080 ts_tablet_manager.cc:1428] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:21.525491 26081 ts_tablet_manager.cc:1428] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:21.649582 26044 raft_consensus.cc:482] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:21.649768 26044 raft_consensus.cc:504] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.650255 26044 leader_election.cc:288] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461), 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097)
I20260810 06:30:21.650836 25340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7978974cbf344c7886744632943d3379" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" is_pre_election: true
I20260810 06:30:21.650913 25581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7978974cbf344c7886744632943d3379" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62" is_pre_election: true
I20260810 06:30:21.651012 25340 raft_consensus.cc:2454] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 0.
I20260810 06:30:21.651103 25581 raft_consensus.cc:2454] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 0.
I20260810 06:30:21.651501 25706 leader_election.cc:302] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9488666d6f4f629fd26b1b9f308e62, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:21.651909 26044 raft_consensus.cc:2781] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:21.651983 26044 raft_consensus.cc:482] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:21.652033 26044 raft_consensus.cc:3037] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:21.653201 26044 raft_consensus.cc:504] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.653611 26044 leader_election.cc:288] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 election: Requested vote from peers 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461), 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097)
I20260810 06:30:21.654057 25340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7978974cbf344c7886744632943d3379" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b6a71c0e0ec4999a271092b5aed5df9"
I20260810 06:30:21.654102 25581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7978974cbf344c7886744632943d3379" candidate_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b9488666d6f4f629fd26b1b9f308e62"
I20260810 06:30:21.654217 25581 raft_consensus.cc:3037] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:21.654217 25340 raft_consensus.cc:3037] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:21.655548 25340 raft_consensus.cc:2454] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 1.
I20260810 06:30:21.655548 25581 raft_consensus.cc:2454] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b79c43ac4a824fc5b7fd6f234b64b5cc in term 1.
I20260810 06:30:21.655959 25706 leader_election.cc:302] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b9488666d6f4f629fd26b1b9f308e62, b79c43ac4a824fc5b7fd6f234b64b5cc; no voters:
I20260810 06:30:21.656173 26044 raft_consensus.cc:2781] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:21.656284 26044 raft_consensus.cc:686] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 LEADER]: Becoming Leader. State: Replica: b79c43ac4a824fc5b7fd6f234b64b5cc, State: Running, Role: LEADER
I20260810 06:30:21.656452 26044 consensus_queue.cc:237] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } }
I20260810 06:30:21.658340 25081 catalog_manager.cc:5495] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc reported cstate change: term changed from 0 to 1, leader changed from <none> to b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195). New cstate: current_term: 1 leader_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b79c43ac4a824fc5b7fd6f234b64b5cc" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260810 06:30:21.690229 26116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:21.686958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.21.195.195:37499)
0810 06:30:21.687262 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:21.687269 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:21.687280 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:30:21.687321 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:21.687323 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:21.687365 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:21.687444 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:21.687670 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:21.688221 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:21.689027 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:21.689259 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:21.689335 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:21.689695 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:21.689783 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:21.689878 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:21.689971 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 06:30:21.690032 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":133,"threads_started":1}
I20260810 06:30:21.697259 25340 raft_consensus.cc:1261] T 7978974cbf344c7886744632943d3379 P 6b6a71c0e0ec4999a271092b5aed5df9 [term 1 FOLLOWER]: Refusing update from remote peer b79c43ac4a824fc5b7fd6f234b64b5cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:21.697253 25581 raft_consensus.cc:1261] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Refusing update from remote peer b79c43ac4a824fc5b7fd6f234b64b5cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:21.697757 25959 consensus_queue.cc:1035] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b6a71c0e0ec4999a271092b5aed5df9" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:21.697949 26044 consensus_queue.cc:1035] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b9488666d6f4f629fd26b1b9f308e62" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 44097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 06:30:21.712033 26034 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 06:30:23.264192 25074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:23.264369 25074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:23.267015 25074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f374ef5dc89746549587c92fb205c063: Sending DeleteTablet for 3 replicas of tablet 7978974cbf344c7886744632943d3379
I20260810 06:30:23.267705 25792 tablet_service.cc:1514] Processing DeleteTablet for tablet 7978974cbf344c7886744632943d3379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:23 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:39032
I20260810 06:30:23.267707 25305 tablet_service.cc:1514] Processing DeleteTablet for tablet 7978974cbf344c7886744632943d3379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:23 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50078
I20260810 06:30:23.267747 25547 tablet_service.cc:1514] Processing DeleteTablet for tablet 7978974cbf344c7886744632943d3379 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:23 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:59422
I20260810 06:30:23.268199 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25198
I20260810 06:30:23.281137 26162 tablet_replica.cc:330] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: stopping tablet replica
I20260810 06:30:23.281360 26162 raft_consensus.cc:2229] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:23.281551 26162 raft_consensus.cc:2258] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:23.287259 26162 ts_tablet_manager.cc:1905] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:23.290060 26162 ts_tablet_manager.cc:1918] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:30:23.290151 26162 log.cc:1196] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/7978974cbf344c7886744632943d3379
I20260810 06:30:23.290395 26162 ts_tablet_manager.cc:1939] T 7978974cbf344c7886744632943d3379 P 1b9488666d6f4f629fd26b1b9f308e62: Deleting consensus metadata
I20260810 06:30:23.291272 25053 catalog_manager.cc:4841] TS 1b9488666d6f4f629fd26b1b9f308e62 (127.21.195.194:44097): tablet 7978974cbf344c7886744632943d3379 (table test-table [id=4c39451e5bd440b79d8e060e9e23ce4a]) successfully deleted
I20260810 06:30:23.321395 26166 tablet_replica.cc:330] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: stopping tablet replica
I20260810 06:30:23.321638 26166 raft_consensus.cc:2229] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:23.321936 26166 raft_consensus.cc:2258] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:23.322731 26166 ts_tablet_manager.cc:1905] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:23.326016 26166 ts_tablet_manager.cc:1918] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 06:30:23.326165 26166 log.cc:1196] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/7978974cbf344c7886744632943d3379
I20260810 06:30:23.326469 26166 ts_tablet_manager.cc:1939] T 7978974cbf344c7886744632943d3379 P b79c43ac4a824fc5b7fd6f234b64b5cc: Deleting consensus metadata
I20260810 06:30:23.327397 25054 catalog_manager.cc:4841] TS b79c43ac4a824fc5b7fd6f234b64b5cc (127.21.195.195:37499): tablet 7978974cbf344c7886744632943d3379 (table test-table [id=4c39451e5bd440b79d8e060e9e23ce4a]) successfully deleted
W20260810 06:30:23.330039 25053 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:35461 (error 108)
I20260810 06:30:23.331012 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25433
I20260810 06:30:23.331482 26170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:23.330968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35461 (local address 127.0.0.1:50098)
0810 06:30:23.331251 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:23.331348 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":85,"threads_started":1}
W20260810 06:30:23.340034 25053 catalog_manager.cc:4584] TS 6b6a71c0e0ec4999a271092b5aed5df9 (127.21.195.193:35461): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7978974cbf344c7886744632943d3379: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35461: connect: Connection refused (error 111)
I20260810 06:30:23.379740 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25672
I20260810 06:30:23.394098 26170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:23.393739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35461 (local address 127.0.0.1:50102)
0810 06:30:23.393928 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:23.394000 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260810 06:30:23.394990 26170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:23.394730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35461 (local address 127.0.0.1:50106)
0810 06:30:23.394860 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:23.394917 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 06:30:23.399255 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25027
2026-08-10T06:30:23Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6492 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:23 dist-test-slave-7lbf krb5kdc[26175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:23 dist-test-slave-7lbf krb5kdc[26175](info): set up 2 sockets
Aug 10 06:30:23 dist-test-slave-7lbf krb5kdc[26175](info): commencing operation
krb5kdc: starting...
W20260810 06:30:24.580148 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:24 dist-test-slave-7lbf krb5kdc[26175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:24.712669 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46541
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:46541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:24.837896 26196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:24.838218 26196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:24.838263 26196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:24.842557 26196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:24.842644 26196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:24.842662 26196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:24.842679 26196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:24.842692 26196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:24.848431 26196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:46541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:24.849807 26196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:24.851022 26196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:24.860685 26208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:24.860882 26196 server_base.cc:1034] running on GCE node
W20260810 06:30:24.860913 26211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:24.860687 26207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:24.861812 26196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:24.863148 26196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:24.864312 26196 hybrid_clock.cc:648] HybridClock initialized: now 1786343424864295 us; error 37 us; skew 500 ppm
Aug 10 06:30:24 dist-test-slave-7lbf krb5kdc[26175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343424, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:24.867395 26196 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:24.868465 26196 webserver.cc:460] Webserver started at http://127.21.195.254:37831/ using document root <none> and password file <none>
I20260810 06:30:24.869095 26196 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:24.869182 26196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:24.869428 26196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:24.871825 26196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "2e858dd902854adc8038770f571440e3"
format_stamp: "Formatted at 2026-08-10 06:30:24 on dist-test-slave-7lbf"
server_key: "ff3d8d91236ff6d6d74ce45d34f57f06"
server_key_iv: "237e152f5c646b437faf517a3a681e04"
server_key_version: "encryptionkey@0"
I20260810 06:30:24.872470 26196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "2e858dd902854adc8038770f571440e3"
format_stamp: "Formatted at 2026-08-10 06:30:24 on dist-test-slave-7lbf"
server_key: "ff3d8d91236ff6d6d74ce45d34f57f06"
server_key_iv: "237e152f5c646b437faf517a3a681e04"
server_key_version: "encryptionkey@0"
I20260810 06:30:24.876974 26196 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:30:24.879948 26218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:24.881382 26196 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:24.881578 26196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "2e858dd902854adc8038770f571440e3"
format_stamp: "Formatted at 2026-08-10 06:30:24 on dist-test-slave-7lbf"
server_key: "ff3d8d91236ff6d6d74ce45d34f57f06"
server_key_iv: "237e152f5c646b437faf517a3a681e04"
server_key_version: "encryptionkey@0"
I20260810 06:30:24.881707 26196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:24.904903 26196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:24.908399 26196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:24.908630 26196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:24.916371 26196 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:46541
I20260810 06:30:24.916386 26309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:46541 every 8 connection(s)
I20260810 06:30:24.917567 26196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:24.920953 26310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:24.920938 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 26196
I20260810 06:30:24.921082 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:24.921420 22287 external_mini_cluster.cc:1428] Setting key d517a7bb0945dcfcfd66ce771edf552c
I20260810 06:30:24.928835 26310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3: Bootstrap starting.
Aug 10 06:30:24 dist-test-slave-7lbf krb5kdc[26175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:24.932051 26310 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:24.932881 26310 log.cc:824] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:24.935523 26310 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3: No bootstrap required, opened a new log
I20260810 06:30:24.936762 26317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:24.923017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44926 (local address 127.21.195.254:46541)
0810 06:30:24.923480 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:24.923498 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:24.923538 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:30:24.924217 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:24.924237 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:24.924604 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:24.924908 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:24.925924 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:24.926970 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:24.928139 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:24.928627 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:24.928743 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:24.931717 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:24.931724 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:24.931740 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:24.931776 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:24.933741 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:24.934258 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:24.934264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:24.934270 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:24.934399 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:24.934673 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:24.934675 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:24.934676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:24.935116 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:24.935276 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:24.935588 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 06:30:24.935958 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":137,"threads_started":1}
I20260810 06:30:24.939881 26310 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e858dd902854adc8038770f571440e3" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46541 } }
I20260810 06:30:24.940158 26310 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:24.940224 26310 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e858dd902854adc8038770f571440e3, State: Initialized, Role: FOLLOWER
I20260810 06:30:24.940721 26310 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e858dd902854adc8038770f571440e3" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46541 } }
I20260810 06:30:24.940863 26310 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:24.940929 26310 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:24.941030 26310 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:24.942121 26310 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e858dd902854adc8038770f571440e3" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46541 } }
I20260810 06:30:24.942487 26310 leader_election.cc:302] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e858dd902854adc8038770f571440e3; no voters:
I20260810 06:30:24.942826 26310 leader_election.cc:288] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:24.942942 26322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:24.943159 26322 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e858dd902854adc8038770f571440e3, State: Running, Role: LEADER
I20260810 06:30:24.943539 26322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e858dd902854adc8038770f571440e3" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46541 } }
I20260810 06:30:24.944139 26310 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:24.945477 26324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e858dd902854adc8038770f571440e3. Latest consensus state: current_term: 1 leader_uuid: "2e858dd902854adc8038770f571440e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e858dd902854adc8038770f571440e3" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46541 } } }
I20260810 06:30:24.945654 26324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:24.945482 26323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e858dd902854adc8038770f571440e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e858dd902854adc8038770f571440e3" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46541 } } }
I20260810 06:30:24.945900 26323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:24.946154 26340 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:24.949323 26340 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:24.955454 26340 catalog_manager.cc:1347] Generated new cluster ID: 9dd298b5a8d94abda5d5612f469e4b03
I20260810 06:30:24.955552 26340 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:24.966059 26340 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:24.967344 26340 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:24.973652 26340 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e858dd902854adc8038770f571440e3: Generated new TSK 0
I20260810 06:30:24.974653 26340 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:25.015125 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46541
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:25.139701 26361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:25.140043 26361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:25.140089 26361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:25.144369 26361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:25.144459 26361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:25.144544 26361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:25.150424 26361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:25.151703 26361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:25.152971 26361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:25.163690 26369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:25.163762 26361 server_base.cc:1034] running on GCE node
W20260810 06:30:25.163664 26371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:25.163695 26373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:25.164467 26361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:25.165230 26361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:25.166409 26361 hybrid_clock.cc:648] HybridClock initialized: now 1786343425166376 us; error 48 us; skew 500 ppm
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[26175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343425, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:25.169616 26361 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:25.170712 26361 webserver.cc:460] Webserver started at http://127.21.195.193:40179/ using document root <none> and password file <none>
I20260810 06:30:25.171362 26361 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:25.171442 26361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:25.171682 26361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:25.174144 26361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "da7e5bb682954f0690ee369ad4fc252a"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "0ef08045d5b1c6dd239e43e9140e3bb8"
server_key_iv: "33ff4428d47adb2a024687fb604a7398"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.174834 26361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "da7e5bb682954f0690ee369ad4fc252a"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "0ef08045d5b1c6dd239e43e9140e3bb8"
server_key_iv: "33ff4428d47adb2a024687fb604a7398"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.179323 26361 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:25.182377 26382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.183876 26361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:25.184020 26361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "da7e5bb682954f0690ee369ad4fc252a"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "0ef08045d5b1c6dd239e43e9140e3bb8"
server_key_iv: "33ff4428d47adb2a024687fb604a7398"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.184149 26361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:25.195640 26361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:25.199087 26361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:25.199301 26361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:25.199991 26361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:25.200973 26361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:25.201027 26361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.201089 26361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:25.201114 26361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.210315 26361 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:34993
I20260810 06:30:25.210399 26580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:34993 every 8 connection(s)
I20260810 06:30:25.211416 26361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:25.213681 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 26361
I20260810 06:30:25.213802 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:25.214133 22287 external_mini_cluster.cc:1428] Setting key 24daaa6fff9becf709b469c33e241192
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[26175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343425, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:25.228191 26317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:25.213476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:49365 (local address 127.21.195.254:46541)
0810 06:30:25.213632 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:25.213637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:25.215175 (+ 1538us) server_negotiation.cc:407] Connection header received
0810 06:30:25.216365 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:25.216369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:25.216428 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:25.216503 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:25.217976 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.218538 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.220268 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.220537 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.220640 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:25.224023 (+ 3383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:25.224026 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:25.224028 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:25.224058 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:25.225825 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:25.226441 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:25.226445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:25.226447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:25.226537 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:25.226959 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:25.226962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:25.226964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:25.227205 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:25.227303 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:25.227887 (+ 584us) server_negotiation.cc:299] Negotiation successful
0810 06:30:25.228047 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:25.229231 26587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:25.214102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46541 (local address 127.21.195.193:49365)
0810 06:30:25.215003 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:25.215058 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:25.216127 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:25.216703 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:25.216711 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:25.217128 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:25.217755 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:25.217781 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.218690 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.218694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:25.220091 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:25.220105 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.220833 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.220845 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:25.221113 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:25.221892 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:25.221917 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:25.223793 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:25.225969 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:25.225977 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:25.226000 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:25.226312 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:25.226628 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:25.226631 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:25.226633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:25.226830 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:25.227300 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:25.227306 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:25.227602 (+ 296us) client_negotiation.cc:769] Sending connection context
0810 06:30:25.227780 (+ 178us) client_negotiation.cc:240] Negotiation successful
0810 06:30:25.228165 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":174,"threads_started":1}
I20260810 06:30:25.230908 26581 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46541
I20260810 06:30:25.231223 26581 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:25.231911 26581 heartbeater.cc:511] Master 127.21.195.254:46541 requested a full tablet report, sending...
I20260810 06:30:25.234025 26256 ts_manager.cc:194] Registered new tserver with Master: da7e5bb682954f0690ee369ad4fc252a (127.21.195.193:34993)
I20260810 06:30:25.235785 26256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:49365
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:25.246519 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46541
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:25.371688 26591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:25.372023 26591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:25.372069 26591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:25.376339 26591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:25.376433 26591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:25.376499 26591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:25.382575 26591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26591
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:25.383826 26591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:25.384987 26591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:30:25.396229 26591 server_base.cc:1034] running on GCE node
W20260810 06:30:25.396166 26600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:25.396164 26603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:25.396166 26599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:25.396966 26591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:25.397771 26591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:25.398944 26591 hybrid_clock.cc:648] HybridClock initialized: now 1786343425398922 us; error 39 us; skew 500 ppm
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[26175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343425, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:25.402235 26591 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:25.403297 26591 webserver.cc:460] Webserver started at http://127.21.195.194:41595/ using document root <none> and password file <none>
I20260810 06:30:25.403970 26591 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:25.404045 26591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:25.404277 26591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:25.406629 26591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "3a068b0fce0f465a8a391be8ade70eee"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "70cc41471a3289c9738c8fc84e76285b"
server_key_iv: "ace27b5fc2656bb30547ec3f497fb9e3"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.407258 26591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "3a068b0fce0f465a8a391be8ade70eee"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "70cc41471a3289c9738c8fc84e76285b"
server_key_iv: "ace27b5fc2656bb30547ec3f497fb9e3"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.411746 26591 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:25.414758 26616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.416392 26591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:25.416553 26591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "3a068b0fce0f465a8a391be8ade70eee"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "70cc41471a3289c9738c8fc84e76285b"
server_key_iv: "ace27b5fc2656bb30547ec3f497fb9e3"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.416692 26591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:25.430256 26591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:25.434087 26591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:25.434304 26591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:25.434994 26591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:25.435962 26591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:25.436028 26591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.436087 26591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:25.436113 26591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.445577 26591 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:41299
I20260810 06:30:25.445618 26800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:41299 every 8 connection(s)
I20260810 06:30:25.446749 26591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:25.454917 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 26591
I20260810 06:30:25.455060 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:25.455420 22287 external_mini_cluster.cc:1428] Setting key 5ae66b6d3018a3e359a6a5e2645c0271
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[26175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343425, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:25.462634 26317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:25.448735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:56431 (local address 127.21.195.254:46541)
0810 06:30:25.448914 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:25.448919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:25.450088 (+ 1169us) server_negotiation.cc:407] Connection header received
0810 06:30:25.451039 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:25.451042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:25.451096 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:25.451177 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:25.452502 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.453075 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.454625 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.454965 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.455095 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:25.458605 (+ 3510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:25.458608 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:25.458610 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:25.458641 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:25.460096 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:25.460796 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:25.460799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:25.460800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:25.460879 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:25.461272 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:25.461276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:25.461277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:25.461583 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:25.461685 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:25.462288 (+ 603us) server_negotiation.cc:299] Negotiation successful
0810 06:30:25.462453 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 06:30:25.463567 26812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:25.449194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46541 (local address 127.21.195.194:56431)
0810 06:30:25.449937 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:25.449987 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:25.450833 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:25.451363 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:25.451372 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:25.451769 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:25.452320 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:25.452336 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.453209 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.453212 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:25.454458 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:25.454472 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.455312 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.455317 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:25.455543 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:25.456237 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:25.456256 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:25.458372 (+ 2116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:25.460239 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:25.460248 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:25.460272 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:25.460695 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:25.460962 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:25.460966 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:25.460968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:25.461164 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:25.461686 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:25.461693 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:25.462007 (+ 314us) client_negotiation.cc:769] Sending connection context
0810 06:30:25.462186 (+ 179us) client_negotiation.cc:240] Negotiation successful
0810 06:30:25.462564 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":111,"threads_started":1}
I20260810 06:30:25.464885 26802 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46541
I20260810 06:30:25.465174 26802 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:25.465842 26802 heartbeater.cc:511] Master 127.21.195.254:46541 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:30:25.467048 26256 ts_manager.cc:194] Registered new tserver with Master: 3a068b0fce0f465a8a391be8ade70eee (127.21.195.194:41299)
I20260810 06:30:25.467666 26256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:56431
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:25.486649 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46541
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:34769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:25.611147 26815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:25.611471 26815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:25.611521 26815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:25.615859 26815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:25.615950 26815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:25.616025 26815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:25.621927 26815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:34769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46541
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:25.623193 26815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:25.624331 26815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:25.635098 26825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:25.635085 26824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:25.635090 26827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:25.635145 26815 server_base.cc:1034] running on GCE node
I20260810 06:30:25.635866 26815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:25.636605 26815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:25.637765 26815 hybrid_clock.cc:648] HybridClock initialized: now 1786343425637744 us; error 36 us; skew 500 ppm
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[26175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343425, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:25.640715 26815 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:25.641811 26815 webserver.cc:460] Webserver started at http://127.21.195.195:43201/ using document root <none> and password file <none>
I20260810 06:30:25.642427 26815 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:25.642494 26815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:25.642690 26815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:25.645076 26815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "37b1e305bf2e4ef2aa32f08f998c4254"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "78dbd1c05b1fcbe66424d5b9e890efa6"
server_key_iv: "adec1e548e2b05c83ef5b04e0a76a132"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.645720 26815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "37b1e305bf2e4ef2aa32f08f998c4254"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "78dbd1c05b1fcbe66424d5b9e890efa6"
server_key_iv: "adec1e548e2b05c83ef5b04e0a76a132"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.649963 26815 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:25.652743 26838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.654163 26815 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:25.654299 26815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "37b1e305bf2e4ef2aa32f08f998c4254"
format_stamp: "Formatted at 2026-08-10 06:30:25 on dist-test-slave-7lbf"
server_key: "78dbd1c05b1fcbe66424d5b9e890efa6"
server_key_iv: "adec1e548e2b05c83ef5b04e0a76a132"
server_key_version: "encryptionkey@0"
I20260810 06:30:25.654413 26815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:25.664453 26815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:25.667582 26815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:25.667768 26815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:25.668409 26815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:25.669335 26815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:25.669386 26815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.669430 26815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:25.669450 26815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:25.679420 26815 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:40575
I20260810 06:30:25.680830 26815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:25.683277 27020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:40575 every 8 connection(s)
I20260810 06:30:25.684288 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 26815
I20260810 06:30:25.684417 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:25.684737 22287 external_mini_cluster.cc:1428] Setting key 52f1fbea7135e1cc4e0eff93c2bac58c
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[26175](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343425, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:25.699301 26317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:25.685652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:54115 (local address 127.21.195.254:46541)
0810 06:30:25.685836 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:25.685841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:25.687500 (+ 1659us) server_negotiation.cc:407] Connection header received
0810 06:30:25.688529 (+ 1029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:25.688533 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:25.688589 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:25.688674 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:25.690218 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.690834 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.692170 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.692418 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.692515 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:25.695500 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:25.695504 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:25.695506 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:25.695538 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:25.696832 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:25.697388 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:25.697391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:25.697392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:25.697470 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:25.697964 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:25.697967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:25.697968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:25.698222 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:25.698317 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:25.699027 (+ 710us) server_negotiation.cc:299] Negotiation successful
0810 06:30:25.699158 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 06:30:25.700322 27023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:25.686411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46541 (local address 127.21.195.195:54115)
0810 06:30:25.687311 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:25.687383 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:25.688271 (+ 888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:25.688860 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:25.688871 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:25.689298 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:25.690008 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:25.690027 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.690978 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.690981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:25.692034 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:25.692047 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:25.692613 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:25.692617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:25.692806 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:25.693472 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:25.693494 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:25.695286 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:25.696965 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:25.696972 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:25.696989 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:25.697289 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:25.697636 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:25.697639 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:25.697641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:25.697842 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:25.698337 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:25.698345 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:25.698723 (+ 378us) client_negotiation.cc:769] Sending connection context
0810 06:30:25.698952 (+ 229us) client_negotiation.cc:240] Negotiation successful
0810 06:30:25.699365 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":147,"threads_started":1}
I20260810 06:30:25.701498 27021 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46541
I20260810 06:30:25.701823 27021 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:25.702401 27021 heartbeater.cc:511] Master 127.21.195.254:46541 requested a full tablet report, sending...
I20260810 06:30:25.703575 26256 ts_manager.cc:194] Registered new tserver with Master: 37b1e305bf2e4ef2aa32f08f998c4254 (127.21.195.195:40575)
I20260810 06:30:25.704191 26256 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:54115
I20260810 06:30:25.711725 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 06:30:25.727281 26317 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:25.725672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44932 (local address 127.21.195.254:46541)
0810 06:30:25.725833 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:25.725839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:25.725950 (+ 111us) server_negotiation.cc:407] Connection header received
0810 06:30:25.726121 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:25.726124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:25.726174 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:25.726245 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:25.727144 (+ 899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44932: BlockingRecv error: recv got EOF from 127.0.0.1:44932 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 06:30:25.729290 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 26361
I20260810 06:30:25.741288 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 26591
I20260810 06:30:25.755229 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 26815
I20260810 06:30:25.833060 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 26196
2026-08-10T06:30:25Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2436 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[27041](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[27041](info): set up 2 sockets
Aug 10 06:30:25 dist-test-slave-7lbf krb5kdc[27041](info): commencing operation
krb5kdc: starting...
W20260810 06:30:27.043545 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:27 dist-test-slave-7lbf krb5kdc[27041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:27.177109 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:42111
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:42111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:27.301337 27061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:27.301724 27061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:27.301793 27061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:27.306088 27061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:27.306178 27061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:27.306207 27061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:27.306228 27061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:27.306250 27061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:27.312103 27061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:42111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:42111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:27.313442 27061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:27.314699 27061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:27.324395 27080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:27.324407 27082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:27.324460 27061 server_base.cc:1034] running on GCE node
W20260810 06:30:27.324399 27089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:27.325254 27061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:27.326553 27061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:27.327723 27061 hybrid_clock.cc:648] HybridClock initialized: now 1786343427327702 us; error 35 us; skew 500 ppm
Aug 10 06:30:27 dist-test-slave-7lbf krb5kdc[27041](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343427, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:27.330828 27061 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:27.331899 27061 webserver.cc:460] Webserver started at http://127.21.195.254:33931/ using document root <none> and password file <none>
I20260810 06:30:27.332507 27061 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:27.332572 27061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:27.332767 27061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:27.335121 27061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5"
format_stamp: "Formatted at 2026-08-10 06:30:27 on dist-test-slave-7lbf"
server_key: "b3e63aeac8a1f0ddc136b11eb9d208a0"
server_key_iv: "69d9fb55aebeead0f701f59e13fc53cb"
server_key_version: "encryptionkey@0"
I20260810 06:30:27.335726 27061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5"
format_stamp: "Formatted at 2026-08-10 06:30:27 on dist-test-slave-7lbf"
server_key: "b3e63aeac8a1f0ddc136b11eb9d208a0"
server_key_iv: "69d9fb55aebeead0f701f59e13fc53cb"
server_key_version: "encryptionkey@0"
I20260810 06:30:27.340039 27061 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:27.343017 27100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:27.344434 27061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:27.344574 27061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5"
format_stamp: "Formatted at 2026-08-10 06:30:27 on dist-test-slave-7lbf"
server_key: "b3e63aeac8a1f0ddc136b11eb9d208a0"
server_key_iv: "69d9fb55aebeead0f701f59e13fc53cb"
server_key_version: "encryptionkey@0"
I20260810 06:30:27.344710 27061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:27.394855 27061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:27.398487 27061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:27.398703 27061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:27.406328 27061 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:42111
I20260810 06:30:27.406680 27193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:42111 every 8 connection(s)
I20260810 06:30:27.407459 27061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:27.410740 27194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:27.416450 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 27061
I20260810 06:30:27.416599 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:27.416925 22287 external_mini_cluster.cc:1428] Setting key 99cc10c0e28bdaf7eb1c9b3493f8228a
I20260810 06:30:27.417707 27194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5: Bootstrap starting.
I20260810 06:30:27.420485 27194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:27.421592 27194 log.cc:824] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:27.424135 27194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5: No bootstrap required, opened a new log
Aug 10 06:30:27 dist-test-slave-7lbf krb5kdc[27041](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:27.428877 27194 raft_consensus.cc:348] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42111 } }
I20260810 06:30:27.429184 27194 raft_consensus.cc:374] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:27.429227 27194 raft_consensus.cc:729] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a037179cd69d4fbcbc6bd9b8536f0ee5, State: Initialized, Role: FOLLOWER
I20260810 06:30:27.429788 27194 consensus_queue.cc:260] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42111 } }
I20260810 06:30:27.429986 27194 raft_consensus.cc:388] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:27.430065 27194 raft_consensus.cc:482] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:27.430184 27194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:27.431411 27194 raft_consensus.cc:504] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42111 } }
I20260810 06:30:27.431872 27194 leader_election.cc:302] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a037179cd69d4fbcbc6bd9b8536f0ee5; no voters:
I20260810 06:30:27.432264 27194 leader_election.cc:288] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:27.432389 27206 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:27.432607 27206 raft_consensus.cc:686] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [term 1 LEADER]: Becoming Leader. State: Replica: a037179cd69d4fbcbc6bd9b8536f0ee5, State: Running, Role: LEADER
I20260810 06:30:27.433033 27206 consensus_queue.cc:237] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42111 } }
I20260810 06:30:27.433208 27203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:27.418433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46304 (local address 127.21.195.254:42111)
0810 06:30:27.418942 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:27.418961 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:27.419002 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:30:27.419722 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:27.419741 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:27.420146 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:27.420475 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:27.421475 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:27.422756 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:27.424001 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:27.424561 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:27.424693 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:27.427753 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:27.427759 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:27.427777 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:27.427813 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:27.429635 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:27.430211 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:27.430216 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:27.430222 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:27.430392 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:27.430716 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:27.430718 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:27.430720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:27.431200 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:27.431360 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:27.431725 (+ 365us) server_negotiation.cc:299] Negotiation successful
0810 06:30:27.432084 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":158,"threads_started":1}
I20260810 06:30:27.433698 27194 sys_catalog.cc:564] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:27.434470 27206 sys_catalog.cc:455] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a037179cd69d4fbcbc6bd9b8536f0ee5. Latest consensus state: current_term: 1 leader_uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42111 } } }
I20260810 06:30:27.434602 27206 sys_catalog.cc:458] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:27.435096 27207 sys_catalog.cc:455] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a037179cd69d4fbcbc6bd9b8536f0ee5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42111 } } }
I20260810 06:30:27.435269 27207 sys_catalog.cc:458] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:27.436724 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 06:30:27.439461 27243 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:30:27.439553 27243 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:30:27.439625 27226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:27.440325 27226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:27.446909 27226 catalog_manager.cc:1347] Generated new cluster ID: 0fd92c535de14ee8aecd612327a524cc
I20260810 06:30:27.446996 27226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:27.458716 27203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:27.453258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46318 (local address 127.21.195.254:42111)
0810 06:30:27.453405 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:27.453411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:27.453720 (+ 309us) server_negotiation.cc:407] Connection header received
0810 06:30:27.453869 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:27.453872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:27.453929 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:27.454003 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:27.454632 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:27.455180 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:27.456087 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:27.456350 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:27.456463 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:27.457385 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:27.457389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:27.457391 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:27.458125 (+ 734us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:27.458171 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:27.458198 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:27.458293 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:27.458477 (+ 184us) server_negotiation.cc:299] Negotiation successful
0810 06:30:27.458555 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 06:30:27.463845 27226 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:27.465219 27226 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:27.473392 27226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a037179cd69d4fbcbc6bd9b8536f0ee5: Generated new TSK 0
I20260810 06:30:27.474578 27226 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:30:27.485081 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 27061
2026-08-10T06:30:27Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1662 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:27 dist-test-slave-7lbf krb5kdc[27266](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:27 dist-test-slave-7lbf krb5kdc[27266](info): set up 2 sockets
Aug 10 06:30:27 dist-test-slave-7lbf krb5kdc[27266](info): commencing operation
krb5kdc: starting...
W20260810 06:30:28.673834 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:28 dist-test-slave-7lbf krb5kdc[27266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:28.806314 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:33321
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:33135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:33321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:28.929240 27292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:28.929615 27292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:28.929682 27292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:28.934027 27292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:28.934118 27292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:28.934144 27292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:28.934165 27292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:28.934185 27292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:28.940052 27292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:33135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:33321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:33321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:28.941375 27292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:28.942615 27292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:28.952205 27299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:28.952188 27300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:28.952324 27292 server_base.cc:1034] running on GCE node
W20260810 06:30:28.952184 27304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:28.953179 27292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:28.954484 27292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:28.955680 27292 hybrid_clock.cc:648] HybridClock initialized: now 1786343428955647 us; error 49 us; skew 500 ppm
Aug 10 06:30:28 dist-test-slave-7lbf krb5kdc[27266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343428, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:28.963181 27292 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:28.964385 27292 webserver.cc:460] Webserver started at http://127.21.195.254:41301/ using document root <none> and password file <none>
I20260810 06:30:28.965052 27292 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:28.965133 27292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:28.965374 27292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:28.967789 27292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "896413a2c25748008ed819786ed47002"
format_stamp: "Formatted at 2026-08-10 06:30:28 on dist-test-slave-7lbf"
server_key: "aff67069cb5f72a6f4de958a8b0ad925"
server_key_iv: "0d61643ca874b432f1d89f3a7aecb1c0"
server_key_version: "encryptionkey@0"
I20260810 06:30:28.968431 27292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "896413a2c25748008ed819786ed47002"
format_stamp: "Formatted at 2026-08-10 06:30:28 on dist-test-slave-7lbf"
server_key: "aff67069cb5f72a6f4de958a8b0ad925"
server_key_iv: "0d61643ca874b432f1d89f3a7aecb1c0"
server_key_version: "encryptionkey@0"
I20260810 06:30:28.972922 27292 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260810 06:30:28.975869 27312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:28.977310 27292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:28.977483 27292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "896413a2c25748008ed819786ed47002"
format_stamp: "Formatted at 2026-08-10 06:30:28 on dist-test-slave-7lbf"
server_key: "aff67069cb5f72a6f4de958a8b0ad925"
server_key_iv: "0d61643ca874b432f1d89f3a7aecb1c0"
server_key_version: "encryptionkey@0"
I20260810 06:30:28.977670 27292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:29.017426 27292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:29.021229 27292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:29.021454 27292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:29.029018 27292 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:33321
I20260810 06:30:29.029292 27398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:33321 every 8 connection(s)
I20260810 06:30:29.030179 27292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:29.033438 27399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:29.035185 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 27292
I20260810 06:30:29.035295 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:29.035576 22287 external_mini_cluster.cc:1428] Setting key 85dc5a43e175588cdef4bfa0a120f30f
I20260810 06:30:29.040108 27399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002: Bootstrap starting.
I20260810 06:30:29.042631 27399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:29.043435 27399 log.cc:824] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:29.045915 27399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002: No bootstrap required, opened a new log
I20260810 06:30:29.049679 27399 raft_consensus.cc:348] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896413a2c25748008ed819786ed47002" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33321 } }
I20260810 06:30:29.049969 27399 raft_consensus.cc:374] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:29.050040 27399 raft_consensus.cc:729] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896413a2c25748008ed819786ed47002, State: Initialized, Role: FOLLOWER
I20260810 06:30:29.050426 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:29.037115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52152 (local address 127.21.195.254:33321)
0810 06:30:29.037669 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:29.037688 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:29.037727 (+ 39us) server_negotiation.cc:407] Connection header received
0810 06:30:29.038400 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:29.038418 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:29.038794 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:29.039162 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:29.040030 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.041095 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.042082 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.042595 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.042749 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:29.045604 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:29.045609 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:29.045625 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:29.045656 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:29.047323 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.047784 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.047790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.047796 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.047919 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.048204 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.048207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.048208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.048660 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:29.048873 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:29.049198 (+ 325us) server_negotiation.cc:299] Negotiation successful
0810 06:30:29.049539 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":165,"threads_started":1}
I20260810 06:30:29.050563 27399 consensus_queue.cc:260] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896413a2c25748008ed819786ed47002" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33321 } }
I20260810 06:30:29.050747 27399 raft_consensus.cc:388] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:29.050827 27399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:29.050930 27399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:29.052105 27399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896413a2c25748008ed819786ed47002" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33321 } }
I20260810 06:30:29.052467 27399 leader_election.cc:302] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 896413a2c25748008ed819786ed47002; no voters:
I20260810 06:30:29.052821 27399 leader_election.cc:288] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:29.052933 27405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:29.053174 27405 raft_consensus.cc:686] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [term 1 LEADER]: Becoming Leader. State: Replica: 896413a2c25748008ed819786ed47002, State: Running, Role: LEADER
I20260810 06:30:29.053583 27405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896413a2c25748008ed819786ed47002" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33321 } }
I20260810 06:30:29.054188 27399 sys_catalog.cc:564] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:29.055323 27406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "896413a2c25748008ed819786ed47002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896413a2c25748008ed819786ed47002" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33321 } } }
I20260810 06:30:29.055493 27406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:29.055790 27407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 896413a2c25748008ed819786ed47002. Latest consensus state: current_term: 1 leader_uuid: "896413a2c25748008ed819786ed47002" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "896413a2c25748008ed819786ed47002" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33321 } } }
I20260810 06:30:29.055892 27407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002 [sys.catalog]: This master's current role is: LEADER
W20260810 06:30:29.058997 27432 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:30:29.059077 27432 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:30:29.059151 27420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:29.059856 27420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:29.065783 27420 catalog_manager.cc:1347] Generated new cluster ID: 3bdb248b1f074c97b4c1dcbf688b12fa
I20260810 06:30:29.065872 27420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:29.078125 27420 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:29.079530 27420 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:29.087395 27420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 896413a2c25748008ed819786ed47002: Generated new TSK 0
I20260810 06:30:29.088320 27420 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:29.129413 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:33321
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:33135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:29.260147 27440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:29.260464 27440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:29.260520 27440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:29.264806 27440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:29.264892 27440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:29.264962 27440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:29.270815 27440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:33135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:33321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:29.272122 27440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:29.273319 27440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:29.283947 27451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:29.283952 27448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:29.284025 27453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:29.284201 27440 server_base.cc:1034] running on GCE node
I20260810 06:30:29.284726 27440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:29.285485 27440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:29.286715 27440 hybrid_clock.cc:648] HybridClock initialized: now 1786343429286705 us; error 90 us; skew 500 ppm
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343429, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:29.289744 27440 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:29.290846 27440 webserver.cc:460] Webserver started at http://127.21.195.193:34873/ using document root <none> and password file <none>
I20260810 06:30:29.291465 27440 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:29.291539 27440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:29.291770 27440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:29.294097 27440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "d22eac5c94084735973b78b94c923d9f"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "f0e19ad9f7fa617fc1d6db9c57872b0b"
server_key_iv: "d98d5e41c9382763addd8303c2f11e2c"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.294718 27440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "d22eac5c94084735973b78b94c923d9f"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "f0e19ad9f7fa617fc1d6db9c57872b0b"
server_key_iv: "d98d5e41c9382763addd8303c2f11e2c"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.298897 27440 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:29.301777 27461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.303211 27440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:29.303345 27440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "d22eac5c94084735973b78b94c923d9f"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "f0e19ad9f7fa617fc1d6db9c57872b0b"
server_key_iv: "d98d5e41c9382763addd8303c2f11e2c"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.303471 27440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:29.319011 27440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:29.322258 27440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:29.322468 27440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:29.323140 27440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:29.324095 27440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:29.324144 27440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.324205 27440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:29.324232 27440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.333482 27440 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:38573
I20260810 06:30:29.333561 27637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:38573 every 8 connection(s)
I20260810 06:30:29.334619 27440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:29.340139 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 27440
I20260810 06:30:29.340296 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:29.340587 22287 external_mini_cluster.cc:1428] Setting key dacbb0f3ddd04b55ebfcf1b67dad0121
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343429, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:29.350385 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:29.336670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:48935 (local address 127.21.195.254:33321)
0810 06:30:29.336808 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:29.336812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:29.337803 (+ 991us) server_negotiation.cc:407] Connection header received
0810 06:30:29.339250 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:29.339254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:29.339317 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:29.339403 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:29.340820 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.341461 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.342821 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.343155 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.343273 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:29.346070 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:29.346074 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:29.346077 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:29.346111 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:29.347700 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.348353 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.348357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.348358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.348456 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.348928 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.348932 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.348934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.349214 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:29.349339 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:29.350042 (+ 703us) server_negotiation.cc:299] Negotiation successful
0810 06:30:29.350200 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:30:29.351289 27641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:29.337115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:33321 (local address 127.21.195.193:48935)
0810 06:30:29.337640 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:29.337691 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:29.338991 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:29.339605 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:29.339613 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:29.340029 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:29.340633 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:29.340651 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.341630 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.341633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:29.342681 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:29.342693 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.343306 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.343309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:29.343469 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:29.344074 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:29.344093 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:29.345861 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:29.347874 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:29.347881 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:29.347897 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:29.348212 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:29.348555 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:29.348558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:29.348560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:29.348789 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:29.349359 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:29.349365 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:29.349732 (+ 367us) client_negotiation.cc:769] Sending connection context
0810 06:30:29.349949 (+ 217us) client_negotiation.cc:240] Negotiation successful
0810 06:30:29.350272 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:29.352737 27639 heartbeater.cc:347] Connected to a master server at 127.21.195.254:33321
I20260810 06:30:29.352995 27639 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:29.353619 27639 heartbeater.cc:511] Master 127.21.195.254:33321 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:29.355430 27341 ts_manager.cc:194] Registered new tserver with Master: d22eac5c94084735973b78b94c923d9f (127.21.195.193:38573)
I20260810 06:30:29.357029 27341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:48935
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:29.370158 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:33321
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:33135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:29.493409 27645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:29.493765 27645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:29.493830 27645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:29.498085 27645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:29.498172 27645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:29.498260 27645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:29.503970 27645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:33135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:33321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:29.505285 27645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:29.506520 27645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:29.517150 27657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:29.517169 27653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:29.517153 27654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:29.517578 27645 server_base.cc:1034] running on GCE node
I20260810 06:30:29.518034 27645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:29.518728 27645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:29.519918 27645 hybrid_clock.cc:648] HybridClock initialized: now 1786343429519893 us; error 34 us; skew 500 ppm
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343429, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:29.522940 27645 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:29.524008 27645 webserver.cc:460] Webserver started at http://127.21.195.194:42165/ using document root <none> and password file <none>
I20260810 06:30:29.524638 27645 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:29.524705 27645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:29.524940 27645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:29.527295 27645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "e2969ac86e2d496bb26b87cd09ccffde"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "9ec12fe19a0419754480dd3fbc35d5a3"
server_key_iv: "af814ca0c5f5ae3b9486769c09876c10"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.528002 27645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "e2969ac86e2d496bb26b87cd09ccffde"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "9ec12fe19a0419754480dd3fbc35d5a3"
server_key_iv: "af814ca0c5f5ae3b9486769c09876c10"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.532397 27645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 06:30:29.535212 27677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.536695 27645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:29.536836 27645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "e2969ac86e2d496bb26b87cd09ccffde"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "9ec12fe19a0419754480dd3fbc35d5a3"
server_key_iv: "af814ca0c5f5ae3b9486769c09876c10"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.536974 27645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:29.547117 27645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:29.550740 27645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:29.550930 27645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:29.551613 27645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:29.552560 27645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:29.552609 27645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.552657 27645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:29.552687 27645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.562302 27645 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:36071
I20260810 06:30:29.562330 27843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:36071 every 8 connection(s)
I20260810 06:30:29.563345 27645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:29.568303 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 27645
I20260810 06:30:29.568432 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:29.568696 22287 external_mini_cluster.cc:1428] Setting key b4eb05cbb02e335f6eaaf715961fff89
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343429, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:29.579186 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:29.565389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:47071 (local address 127.21.195.254:33321)
0810 06:30:29.565580 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:29.565584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:29.566614 (+ 1030us) server_negotiation.cc:407] Connection header received
0810 06:30:29.568096 (+ 1482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:29.568100 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:29.568165 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:29.568246 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:29.569843 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.570533 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.571775 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.572086 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.572193 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:29.575222 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:29.575226 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:29.575228 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:29.575255 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:29.576771 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.577443 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.577445 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.577446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.577553 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.577966 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.577968 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.577969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.578168 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:29.578244 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:29.578935 (+ 691us) server_negotiation.cc:299] Negotiation successful
0810 06:30:29.579056 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:30:29.580560 27847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:29.565900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:33321 (local address 127.21.195.194:47071)
0810 06:30:29.566429 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:29.566481 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:29.567838 (+ 1357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:29.568489 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:29.568501 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:29.568941 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:29.569660 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:29.569683 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.570679 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.570682 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:29.571648 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:29.571658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.572248 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.572253 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:29.572487 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:29.573141 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:29.573163 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:29.575028 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:29.576913 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:29.576922 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:29.576944 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:29.577344 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:29.577636 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:29.577640 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:29.577642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:29.577862 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:29.578266 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:29.578273 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:29.578658 (+ 385us) client_negotiation.cc:769] Sending connection context
0810 06:30:29.578912 (+ 254us) client_negotiation.cc:240] Negotiation successful
0810 06:30:29.579328 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":133,"threads_started":1}
I20260810 06:30:29.581998 27844 heartbeater.cc:347] Connected to a master server at 127.21.195.254:33321
I20260810 06:30:29.582279 27844 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:29.582851 27844 heartbeater.cc:511] Master 127.21.195.254:33321 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:30:29.584030 27341 ts_manager.cc:194] Registered new tserver with Master: e2969ac86e2d496bb26b87cd09ccffde (127.21.195.194:36071)
I20260810 06:30:29.584653 27341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:47071
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:29.600589 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:33321
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:33135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:29.725870 27851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:29.726191 27851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:29.726236 27851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:29.730489 27851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:29.730589 27851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:29.730651 27851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:29.736403 27851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:33135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:33321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:29.737696 27851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:29.738829 27851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:29.749806 27868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:29.749924 27851 server_base.cc:1034] running on GCE node
W20260810 06:30:29.749800 27863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:29.749800 27864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:29.750608 27851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:29.751324 27851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:29.752529 27851 hybrid_clock.cc:648] HybridClock initialized: now 1786343429752506 us; error 38 us; skew 500 ppm
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343429, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:29.755777 27851 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:29.756896 27851 webserver.cc:460] Webserver started at http://127.21.195.195:35045/ using document root <none> and password file <none>
I20260810 06:30:29.757535 27851 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:29.757622 27851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:29.757859 27851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:29.760108 27851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "4d3baaa70b874edd8a8014e5eeccac51"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "ed5094b0b6501d75e3bfa8c80a65c629"
server_key_iv: "733a6e97d67e26396e2cafd594ef7ddb"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.760732 27851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "4d3baaa70b874edd8a8014e5eeccac51"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "ed5094b0b6501d75e3bfa8c80a65c629"
server_key_iv: "733a6e97d67e26396e2cafd594ef7ddb"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.765045 27851 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:30:29.768064 27877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.769559 27851 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 06:30:29.769699 27851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "4d3baaa70b874edd8a8014e5eeccac51"
format_stamp: "Formatted at 2026-08-10 06:30:29 on dist-test-slave-7lbf"
server_key: "ed5094b0b6501d75e3bfa8c80a65c629"
server_key_iv: "733a6e97d67e26396e2cafd594ef7ddb"
server_key_version: "encryptionkey@0"
I20260810 06:30:29.769821 27851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:29.779731 27851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:29.783380 27851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:29.783593 27851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:29.784315 27851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:29.785277 27851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:29.785341 27851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.785409 27851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:29.785436 27851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:29.794838 27851 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:38523
I20260810 06:30:29.794914 28048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:38523 every 8 connection(s)
I20260810 06:30:29.795883 27851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:29.798566 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 27851
I20260810 06:30:29.798672 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:29.798965 22287 external_mini_cluster.cc:1428] Setting key c77abe9a9c7a375fc99582e2204fec03
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343429, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:29.811456 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:29.798018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:54893 (local address 127.21.195.254:33321)
0810 06:30:29.798183 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:29.798189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:29.799256 (+ 1067us) server_negotiation.cc:407] Connection header received
0810 06:30:29.800781 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:29.800786 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:29.800845 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:29.800925 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:29.802404 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.802945 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.804151 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.804384 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.804487 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:29.807528 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:29.807532 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:29.807535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:29.807569 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:29.809331 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.809908 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.809911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.809912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.809996 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.810284 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.810286 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.810288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.810481 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:29.810569 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:29.811128 (+ 559us) server_negotiation.cc:299] Negotiation successful
0810 06:30:29.811251 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:30:29.812400 28052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:29.798495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:33321 (local address 127.21.195.195:54893)
0810 06:30:29.799059 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:29.799123 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:29.800529 (+ 1406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:29.801171 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:29.801182 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:29.801677 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:29.802237 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:29.802253 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.803077 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.803080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:29.804020 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:29.804031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.804551 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.804556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:29.804733 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:29.805303 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:29.805321 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:29.807300 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:29.809449 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:29.809455 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:29.809469 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:29.809802 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:29.810055 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:29.810057 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:29.810059 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:29.810215 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:29.810570 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:29.810576 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:29.810851 (+ 275us) client_negotiation.cc:769] Sending connection context
0810 06:30:29.811044 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 06:30:29.811349 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":149,"threads_started":1}
I20260810 06:30:29.813711 28049 heartbeater.cc:347] Connected to a master server at 127.21.195.254:33321
I20260810 06:30:29.813992 28049 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:29.814595 28049 heartbeater.cc:511] Master 127.21.195.254:33321 requested a full tablet report, sending...
I20260810 06:30:29.815662 27341 ts_manager.cc:194] Registered new tserver with Master: 4d3baaa70b874edd8a8014e5eeccac51 (127.21.195.195:38523)
I20260810 06:30:29.816249 27341 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:54893
I20260810 06:30:29.825183 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343429, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 06:30:29 dist-test-slave-7lbf krb5kdc[27266](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343429, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:29.852886 27402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:29.844354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52166 (local address 127.21.195.254:33321)
0810 06:30:29.844529 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:29.844534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:29.844659 (+ 125us) server_negotiation.cc:407] Connection header received
0810 06:30:29.844783 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:29.844786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:29.844833 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:29.844914 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:29.845699 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.846256 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.847108 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:29.847320 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:29.847393 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:29.849932 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:29.849936 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:29.849938 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:29.849970 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:29.851381 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.851758 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.851761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.851763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.851865 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:29.852092 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:29.852095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:29.852096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:29.852336 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:29.852443 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:29.852612 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 06:30:29.852720 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260810 06:30:29.853356 27341 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52166
I20260810 06:30:29.854303 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 27440
I20260810 06:30:29.863850 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 27645
I20260810 06:30:29.911402 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 27851
I20260810 06:30:29.928218 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 27292
2026-08-10T06:30:29Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2440 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:30 dist-test-slave-7lbf krb5kdc[28069](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:30 dist-test-slave-7lbf krb5kdc[28069](info): set up 2 sockets
Aug 10 06:30:30 dist-test-slave-7lbf krb5kdc[28069](info): commencing operation
krb5kdc: starting...
W20260810 06:30:31.120522 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:31 dist-test-slave-7lbf krb5kdc[28069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:31.254917 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39587
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:39587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:31.380115 28089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:31.380475 28089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:31.380522 28089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:31.385111 28089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:31.385212 28089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:31.385233 28089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:31.385250 28089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:31.385264 28089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:31.391204 28089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:39587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:31.392520 28089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:31.393740 28089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:31.403213 28101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:31.403242 28107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:31.403327 28104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:31.403528 28089 server_base.cc:1034] running on GCE node
I20260810 06:30:31.404245 28089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:31.405596 28089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:31.406773 28089 hybrid_clock.cc:648] HybridClock initialized: now 1786343431406752 us; error 45 us; skew 500 ppm
Aug 10 06:30:31 dist-test-slave-7lbf krb5kdc[28069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343431, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:31.409818 28089 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:31.410900 28089 webserver.cc:460] Webserver started at http://127.21.195.254:33649/ using document root <none> and password file <none>
I20260810 06:30:31.411509 28089 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:31.411579 28089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:31.411779 28089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:31.414166 28089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "a71ea1de1a77fe475ff0c1c5e4f9ad5c"
server_key_iv: "f8faa1d84be21d88369dd3dcdb4bd491"
server_key_version: "encryptionkey@0"
I20260810 06:30:31.414758 28089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "a71ea1de1a77fe475ff0c1c5e4f9ad5c"
server_key_iv: "f8faa1d84be21d88369dd3dcdb4bd491"
server_key_version: "encryptionkey@0"
I20260810 06:30:31.418985 28089 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:31.421738 28116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:31.423162 28089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:31.423295 28089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "a71ea1de1a77fe475ff0c1c5e4f9ad5c"
server_key_iv: "f8faa1d84be21d88369dd3dcdb4bd491"
server_key_version: "encryptionkey@0"
I20260810 06:30:31.423410 28089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:31.440521 28089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:31.444190 28089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:31.444377 28089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:31.451937 28089 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:39587
I20260810 06:30:31.451952 28199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:39587 every 8 connection(s)
I20260810 06:30:31.453061 28089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:31.453435 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 28089
I20260810 06:30:31.453603 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:31.453929 22287 external_mini_cluster.cc:1428] Setting key 8d348bf4305dd46d75daebefced38776
I20260810 06:30:31.456645 28200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 06:30:31 dist-test-slave-7lbf krb5kdc[28069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:31.464370 28200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33: Bootstrap starting.
I20260810 06:30:31.467660 28200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:31.468745 28200 log.cc:824] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:31.469882 28210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:31.455400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53182 (local address 127.21.195.254:39587)
0810 06:30:31.455844 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:31.455869 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:31.455910 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:30:31.456584 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:31.456603 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:31.457013 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:31.457345 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:31.458383 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:31.459448 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:31.460686 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:31.461202 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:31.461334 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:31.464346 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:31.464353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:31.464373 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:31.464415 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:31.466408 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:31.466936 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:31.466943 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:31.466951 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:31.467123 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:31.467366 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:31.467369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:31.467371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:31.468015 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:31.468220 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:31.468506 (+ 286us) server_negotiation.cc:299] Negotiation successful
0810 06:30:31.468866 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":125,"threads_started":1}
I20260810 06:30:31.473351 28200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33: No bootstrap required, opened a new log
I20260810 06:30:31.477494 28200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39587 } }
I20260810 06:30:31.477828 28200 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:31.477887 28200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f5d3462e7204f5a89e1b9dcd9d86e33, State: Initialized, Role: FOLLOWER
I20260810 06:30:31.478363 28200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39587 } }
I20260810 06:30:31.478502 28200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:31.478569 28200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:31.478674 28200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:31.479733 28200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39587 } }
I20260810 06:30:31.480134 28200 leader_election.cc:302] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f5d3462e7204f5a89e1b9dcd9d86e33; no voters:
I20260810 06:30:31.480482 28200 leader_election.cc:288] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:31.480624 28212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:31.480854 28212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [term 1 LEADER]: Becoming Leader. State: Replica: 2f5d3462e7204f5a89e1b9dcd9d86e33, State: Running, Role: LEADER
I20260810 06:30:31.481215 28212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39587 } }
I20260810 06:30:31.481853 28200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:31.483104 28215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f5d3462e7204f5a89e1b9dcd9d86e33. Latest consensus state: current_term: 1 leader_uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39587 } } }
I20260810 06:30:31.483246 28215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:31.483495 28214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f5d3462e7204f5a89e1b9dcd9d86e33" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39587 } } }
I20260810 06:30:31.483604 28214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:31.484661 28224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:31.488153 28224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:31.494879 28224 catalog_manager.cc:1347] Generated new cluster ID: 153bd041adfe4f8dbbf82eec3d516647
I20260810 06:30:31.494973 28224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:31.514592 28224 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:31.516036 28224 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:31.530167 28224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f5d3462e7204f5a89e1b9dcd9d86e33: Generated new TSK 0
I20260810 06:30:31.531075 28224 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:31.573134 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39587
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:31.705034 28243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:31.705372 28243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:31.705418 28243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:31.709723 28243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:31.709877 28243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:31.709949 28243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:31.715808 28243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:31.717056 28243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:31.718200 28243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:31.729003 28253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:31.729008 28259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:31.729003 28257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:31.729293 28243 server_base.cc:1034] running on GCE node
I20260810 06:30:31.730049 28243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:31.730791 28243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:31.732054 28243 hybrid_clock.cc:648] HybridClock initialized: now 1786343431732033 us; error 48 us; skew 500 ppm
Aug 10 06:30:31 dist-test-slave-7lbf krb5kdc[28069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343431, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:31.735252 28243 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:31.736330 28243 webserver.cc:460] Webserver started at http://127.21.195.193:41493/ using document root <none> and password file <none>
I20260810 06:30:31.736997 28243 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:31.737072 28243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:31.737298 28243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:31.739655 28243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "75cecbb58a57420ab821f45630b1b51f"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "165290dda58e121a44a27828d594b207"
server_key_iv: "5b9c39f892ce89d6d4aff67693703f38"
server_key_version: "encryptionkey@0"
I20260810 06:30:31.740288 28243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "75cecbb58a57420ab821f45630b1b51f"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "165290dda58e121a44a27828d594b207"
server_key_iv: "5b9c39f892ce89d6d4aff67693703f38"
server_key_version: "encryptionkey@0"
I20260810 06:30:31.744751 28243 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 06:30:31.747859 28269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:31.749315 28243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:31.749467 28243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "75cecbb58a57420ab821f45630b1b51f"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "165290dda58e121a44a27828d594b207"
server_key_iv: "5b9c39f892ce89d6d4aff67693703f38"
server_key_version: "encryptionkey@0"
I20260810 06:30:31.749642 28243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:31.785686 28243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:31.789222 28243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:31.789431 28243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:31.790191 28243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:31.791199 28243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:31.791251 28243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:31.791296 28243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:31.791318 28243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:31.800475 28243 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:41265
I20260810 06:30:31.800503 28440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:41265 every 8 connection(s)
I20260810 06:30:31.801507 28243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:31.802809 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 28243
I20260810 06:30:31.802942 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:31.803285 22287 external_mini_cluster.cc:1428] Setting key 3c78baf78fa438306e885202ffbe982d
Aug 10 06:30:31 dist-test-slave-7lbf krb5kdc[28069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343431, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:31.818567 28210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:31.803788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:34735 (local address 127.21.195.254:39587)
0810 06:30:31.803970 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:31.803975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:31.805016 (+ 1041us) server_negotiation.cc:407] Connection header received
0810 06:30:31.806491 (+ 1475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:31.806494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:31.806553 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:31.806643 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:31.807927 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:31.808629 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:31.810314 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:31.810580 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:31.810673 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:31.813920 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:31.813925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:31.813928 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:31.813963 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:31.815858 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:31.816772 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:31.816776 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:31.816778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:31.816879 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:31.817271 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:31.817274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:31.817276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:31.817498 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:31.817611 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:31.818211 (+ 600us) server_negotiation.cc:299] Negotiation successful
0810 06:30:31.818396 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:31.819588 28443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:31.804292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39587 (local address 127.21.195.193:34735)
0810 06:30:31.804841 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:31.804891 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:31.806254 (+ 1363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:31.806815 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:31.806823 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:31.807210 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:31.807757 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:31.807772 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:31.808765 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:31.808768 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:31.810179 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:31.810191 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:31.810746 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:31.810750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:31.810961 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:31.811692 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:31.811716 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:31.813672 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:31.816032 (+ 2360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:31.816040 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:31.816063 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:31.816597 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:31.816969 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:31.816972 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:31.816974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:31.817151 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:31.817615 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:31.817622 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:31.817967 (+ 345us) client_negotiation.cc:769] Sending connection context
0810 06:30:31.818150 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 06:30:31.818526 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":116,"threads_started":1}
I20260810 06:30:31.821108 28441 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39587
I20260810 06:30:31.821385 28441 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:31.822005 28441 heartbeater.cc:511] Master 127.21.195.254:39587 requested a full tablet report, sending...
I20260810 06:30:31.823726 28139 ts_manager.cc:194] Registered new tserver with Master: 75cecbb58a57420ab821f45630b1b51f (127.21.195.193:41265)
I20260810 06:30:31.824959 28139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:34735
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:31.835029 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39587
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:31.961304 28446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:31.961697 28446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:31.961748 28446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:31.966183 28446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:31.966275 28446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:31.966341 28446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:31.972450 28446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:31.973780 28446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:31.974962 28446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:31.986330 28454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:31.986357 28459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:31.986378 28456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:31.986775 28446 server_base.cc:1034] running on GCE node
I20260810 06:30:31.987370 28446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:31.988183 28446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:31.989377 28446 hybrid_clock.cc:648] HybridClock initialized: now 1786343431989341 us; error 52 us; skew 500 ppm
Aug 10 06:30:31 dist-test-slave-7lbf krb5kdc[28069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343431, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:31.992614 28446 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:31.993811 28446 webserver.cc:460] Webserver started at http://127.21.195.194:39177/ using document root <none> and password file <none>
I20260810 06:30:31.994473 28446 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:31.994558 28446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:31.994796 28446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:31.997215 28446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "08d3ee280bbd4948babdfba0490bf63a"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "803959d0ac1401c55f8b0e027bdc6a1e"
server_key_iv: "963e7f5b413393e6fa58c9c093deea5e"
server_key_version: "encryptionkey@0"
I20260810 06:30:31.997915 28446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "08d3ee280bbd4948babdfba0490bf63a"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "803959d0ac1401c55f8b0e027bdc6a1e"
server_key_iv: "963e7f5b413393e6fa58c9c093deea5e"
server_key_version: "encryptionkey@0"
I20260810 06:30:32.002552 28446 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 06:30:32.005451 28473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:32.007083 28446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:32.007251 28446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "08d3ee280bbd4948babdfba0490bf63a"
format_stamp: "Formatted at 2026-08-10 06:30:31 on dist-test-slave-7lbf"
server_key: "803959d0ac1401c55f8b0e027bdc6a1e"
server_key_iv: "963e7f5b413393e6fa58c9c093deea5e"
server_key_version: "encryptionkey@0"
I20260810 06:30:32.007390 28446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:32.023167 28446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:32.026504 28446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:32.026710 28446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:32.027464 28446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:32.028496 28446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:32.028549 28446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:32.028599 28446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:32.028627 28446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:32.038061 28446 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:40649
I20260810 06:30:32.038084 28658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:40649 every 8 connection(s)
I20260810 06:30:32.039135 28446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:32.043723 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 28446
I20260810 06:30:32.043859 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:32.044191 22287 external_mini_cluster.cc:1428] Setting key aa1373fa863e2bef75a1242851f64034
Aug 10 06:30:32 dist-test-slave-7lbf krb5kdc[28069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343431, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:32.055442 28210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:32.041141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:35099 (local address 127.21.195.254:39587)
0810 06:30:32.041296 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:32.041299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:32.042332 (+ 1033us) server_negotiation.cc:407] Connection header received
0810 06:30:32.043793 (+ 1461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:32.043798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:32.043863 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:32.043981 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:32.045628 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.046326 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.047615 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.047936 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.048032 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:32.051200 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:32.051203 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:32.051205 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:32.051235 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:32.052744 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:32.053495 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:32.053500 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:32.053501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:32.053631 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:32.054074 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:32.054076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:32.054077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:32.054279 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:32.054362 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:32.055159 (+ 797us) server_negotiation.cc:299] Negotiation successful
0810 06:30:32.055293 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:30:32.056756 28662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:32.041622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39587 (local address 127.21.195.194:35099)
0810 06:30:32.042138 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:32.042189 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:32.043536 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:32.044173 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:32.044182 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:32.044653 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:32.045421 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:32.045446 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.046502 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.046505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:32.047477 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:32.047490 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.048115 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.048120 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:32.048350 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:32.049033 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:32.049057 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:32.050973 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:32.052877 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:32.052886 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:32.052910 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:32.053325 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:32.053729 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:32.053733 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:32.053735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:32.053979 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:32.054389 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:32.054398 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:32.054837 (+ 439us) client_negotiation.cc:769] Sending connection context
0810 06:30:32.055093 (+ 256us) client_negotiation.cc:240] Negotiation successful
0810 06:30:32.055521 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":131,"threads_started":1}
I20260810 06:30:32.058066 28659 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39587
I20260810 06:30:32.058398 28659 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:30:32.059067 28659 heartbeater.cc:511] Master 127.21.195.254:39587 requested a full tablet report, sending...
I20260810 06:30:32.060400 28139 ts_manager.cc:194] Registered new tserver with Master: 08d3ee280bbd4948babdfba0490bf63a (127.21.195.194:40649)
I20260810 06:30:32.061015 28139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:35099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:32.075050 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39587
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:32.202621 28667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:32.202968 28667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:32.203042 28667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:32.207490 28667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:32.207593 28667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:32.207700 28667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:32.213758 28667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:32.215039 28667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:32.216233 28667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:32.227365 28678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:32.227406 28667 server_base.cc:1034] running on GCE node
W20260810 06:30:32.227419 28675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:32.227515 28673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:32.228132 28667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:32.228888 28667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:32.230060 28667 hybrid_clock.cc:648] HybridClock initialized: now 1786343432230023 us; error 55 us; skew 500 ppm
Aug 10 06:30:32 dist-test-slave-7lbf krb5kdc[28069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343432, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:32.233026 28667 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:32.234117 28667 webserver.cc:460] Webserver started at http://127.21.195.195:33541/ using document root <none> and password file <none>
I20260810 06:30:32.234721 28667 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:32.234789 28667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:32.234983 28667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:32.237278 28667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "848d0884ddc44466a29d3befc6925f76"
format_stamp: "Formatted at 2026-08-10 06:30:32 on dist-test-slave-7lbf"
server_key: "a39473d97d7d6ab615113999b3a6a303"
server_key_iv: "0e898429f12d4d7ea608a39bb3ed0c3e"
server_key_version: "encryptionkey@0"
I20260810 06:30:32.239784 28667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "848d0884ddc44466a29d3befc6925f76"
format_stamp: "Formatted at 2026-08-10 06:30:32 on dist-test-slave-7lbf"
server_key: "a39473d97d7d6ab615113999b3a6a303"
server_key_iv: "0e898429f12d4d7ea608a39bb3ed0c3e"
server_key_version: "encryptionkey@0"
I20260810 06:30:32.245358 28667 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260810 06:30:32.248955 28689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:32.250705 28667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:32.250957 28667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "848d0884ddc44466a29d3befc6925f76"
format_stamp: "Formatted at 2026-08-10 06:30:32 on dist-test-slave-7lbf"
server_key: "a39473d97d7d6ab615113999b3a6a303"
server_key_iv: "0e898429f12d4d7ea608a39bb3ed0c3e"
server_key_version: "encryptionkey@0"
I20260810 06:30:32.251190 28667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:32.275060 28667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:32.279165 28667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:32.279381 28667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:32.282284 28667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:32.284977 28667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:32.285059 28667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:32.285123 28667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:32.285156 28667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:32.297286 28667 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:41789
I20260810 06:30:32.297303 28866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:41789 every 8 connection(s)
I20260810 06:30:32.298533 28667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:32.305117 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 28667
I20260810 06:30:32.305261 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:32.305588 22287 external_mini_cluster.cc:1428] Setting key 89be59f35757409c3f3b13b3998c8929
Aug 10 06:30:32 dist-test-slave-7lbf krb5kdc[28069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343432, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:32.315755 28210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:32.300820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:48253 (local address 127.21.195.254:39587)
0810 06:30:32.301001 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:32.301006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:32.302131 (+ 1125us) server_negotiation.cc:407] Connection header received
0810 06:30:32.304239 (+ 2108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:32.304243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:32.304325 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:32.304420 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:32.306225 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.306940 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.308674 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.308915 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.309009 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:32.311986 (+ 2977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:32.311990 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:32.311992 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:32.312032 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:32.313748 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:32.314334 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:32.314336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:32.314337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:32.314416 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:32.314706 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:32.314708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:32.314709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:32.314896 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:32.314968 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:32.315501 (+ 533us) server_negotiation.cc:299] Negotiation successful
0810 06:30:32.315621 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 06:30:32.316756 28871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:32.301274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39587 (local address 127.21.195.195:48253)
0810 06:30:32.301914 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:32.301992 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:32.303895 (+ 1903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:32.304682 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:32.304694 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:32.305229 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:32.306068 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:32.306093 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.307081 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.307084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:32.308556 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:32.308569 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.309074 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.309078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:32.309289 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:32.309933 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:32.309952 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:32.311792 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:32.313863 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:32.313869 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:32.313887 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:32.314243 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:32.314481 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:32.314483 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:32.314484 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:32.314635 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:32.314976 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:32.314981 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:32.315271 (+ 290us) client_negotiation.cc:769] Sending connection context
0810 06:30:32.315454 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 06:30:32.315779 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":171,"threads_started":1}
I20260810 06:30:32.318173 28867 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39587
I20260810 06:30:32.318459 28867 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:32.319074 28867 heartbeater.cc:511] Master 127.21.195.254:39587 requested a full tablet report, sending...
I20260810 06:30:32.320227 28139 ts_manager.cc:194] Registered new tserver with Master: 848d0884ddc44466a29d3befc6925f76 (127.21.195.195:41789)
I20260810 06:30:32.320833 28139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:48253
I20260810 06:30:32.332213 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 06:30:32 dist-test-slave-7lbf krb5kdc[28069](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:30:32 dist-test-slave-7lbf krb5kdc[28069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:32.400707 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:32.390234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46746 (local address 127.21.195.193:41265)
0810 06:30:32.390572 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:32.390582 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:32.390614 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:30:32.390670 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:32.390676 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:32.390891 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:32.391033 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:32.392085 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.392918 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.393984 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.394462 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.394558 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:32.397253 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:32.397269 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:32.397289 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:32.397324 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:32.398935 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:32.399420 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:32.399426 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:32.399427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:32.399522 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:32.399734 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:32.399736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:32.399737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:32.400032 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:32.400219 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:32.400401 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 06:30:32.400552 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":104,"threads_started":1}
Aug 10 06:30:32 dist-test-slave-7lbf krb5kdc[28069](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343432, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:32.413304 28210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:32.404700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53198 (local address 127.21.195.254:39587)
0810 06:30:32.404874 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:32.404880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:32.404938 (+ 58us) server_negotiation.cc:407] Connection header received
0810 06:30:32.405062 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:32.405065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:32.405115 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:32.405189 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:32.405880 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.406422 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.407213 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:32.407466 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:32.407558 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:32.409959 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:32.409963 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:32.409965 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:32.409996 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:32.411434 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:32.411912 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:32.411915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:32.411917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:32.412012 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:32.412343 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:32.412344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:32.412345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:32.412587 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:32.412714 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:32.412996 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 06:30:32.413129 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260810 06:30:32.413800 28139 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53198
I20260810 06:30:32.414496 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 28243
I20260810 06:30:32.430629 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 28446
I20260810 06:30:32.442417 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 28667
I20260810 06:30:32.459944 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 28089
2026-08-10T06:30:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2524 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:34 dist-test-slave-7lbf krb5kdc[28888](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:34 dist-test-slave-7lbf krb5kdc[28888](info): set up 2 sockets
Aug 10 06:30:34 dist-test-slave-7lbf krb5kdc[28888](info): commencing operation
krb5kdc: starting...
W20260810 06:30:35.184871 22287 mini_kdc.cc:121] Time spent starting KDC: real 2.689s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:35 dist-test-slave-7lbf krb5kdc[28888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:35.318456 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36775
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:36775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:35.445650 28914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:35.445979 28914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:35.446046 28914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:35.450343 28914 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:35.450439 28914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:35.450467 28914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:35.450490 28914 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:35.450542 28914 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:35.456350 28914 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:36775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:35.457741 28914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:35.458972 28914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:30:35.468406 28914 server_base.cc:1034] running on GCE node
W20260810 06:30:35.468340 28921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:35.468336 28922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:35.468333 28926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:35.469363 28914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:35.470747 28914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:35.471951 28914 hybrid_clock.cc:648] HybridClock initialized: now 1786343435471933 us; error 44 us; skew 500 ppm
Aug 10 06:30:35 dist-test-slave-7lbf krb5kdc[28888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343435, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:35.478193 28914 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:35.480563 28914 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:35.480652 28914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:35.480912 28914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:35.483422 28914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "25378ed3f0f74744a6d304d9259db08c"
format_stamp: "Formatted at 2026-08-10 06:30:35 on dist-test-slave-7lbf"
server_key: "3e70d59a8e4fde2b221e0a16445787b9"
server_key_iv: "fbb7e1cc8939c645fb08203fc2e98065"
server_key_version: "encryptionkey@0"
I20260810 06:30:35.484113 28914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "25378ed3f0f74744a6d304d9259db08c"
format_stamp: "Formatted at 2026-08-10 06:30:35 on dist-test-slave-7lbf"
server_key: "3e70d59a8e4fde2b221e0a16445787b9"
server_key_iv: "fbb7e1cc8939c645fb08203fc2e98065"
server_key_version: "encryptionkey@0"
I20260810 06:30:35.488689 28914 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:30:35.491710 28937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:35.493198 28914 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 06:30:35.493361 28914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "25378ed3f0f74744a6d304d9259db08c"
format_stamp: "Formatted at 2026-08-10 06:30:35 on dist-test-slave-7lbf"
server_key: "3e70d59a8e4fde2b221e0a16445787b9"
server_key_iv: "fbb7e1cc8939c645fb08203fc2e98065"
server_key_version: "encryptionkey@0"
I20260810 06:30:35.493490 28914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:35.508981 28914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:35.512842 28914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:35.513118 28914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:35.520671 28914 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:36775
I20260810 06:30:35.520937 29011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:36775 every 8 connection(s)
I20260810 06:30:35.521562 28914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:35.524729 29013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:35.526998 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 28914
I20260810 06:30:35.527135 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:35.527419 22287 external_mini_cluster.cc:1428] Setting key 145affb0a465f4010834203c6e7dad93
I20260810 06:30:35.532534 29013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c: Bootstrap starting.
I20260810 06:30:35.535588 29013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:35.536564 29013 log.cc:824] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:30:35 dist-test-slave-7lbf krb5kdc[28888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:35.539278 29013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c: No bootstrap required, opened a new log
I20260810 06:30:35.544176 29013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25378ed3f0f74744a6d304d9259db08c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36775 } }
I20260810 06:30:35.544498 29013 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:35.544543 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:35.529001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47556 (local address 127.21.195.254:36775)
0810 06:30:35.529496 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:35.529538 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:35.529588 (+ 50us) server_negotiation.cc:407] Connection header received
0810 06:30:35.530386 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:35.530414 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:35.530924 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:35.531358 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:35.532160 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:35.533679 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:35.534628 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:35.535357 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:35.535538 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:35.538604 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:35.538612 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:35.538630 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:35.538666 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:35.540730 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:35.541224 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:35.541231 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:35.541238 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:35.541410 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:35.541787 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:35.541790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:35.541792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:35.542420 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:35.542633 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:35.543023 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 06:30:35.543391 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":127,"threads_started":1}
I20260810 06:30:35.544576 29013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25378ed3f0f74744a6d304d9259db08c, State: Initialized, Role: FOLLOWER
I20260810 06:30:35.545082 29013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25378ed3f0f74744a6d304d9259db08c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36775 } }
I20260810 06:30:35.545224 29013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:35.545284 29013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:35.545383 29013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:35.546689 29013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25378ed3f0f74744a6d304d9259db08c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36775 } }
I20260810 06:30:35.547112 29013 leader_election.cc:302] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25378ed3f0f74744a6d304d9259db08c; no voters:
I20260810 06:30:35.547493 29013 leader_election.cc:288] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:35.547590 29024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:35.547829 29024 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [term 1 LEADER]: Becoming Leader. State: Replica: 25378ed3f0f74744a6d304d9259db08c, State: Running, Role: LEADER
I20260810 06:30:35.548214 29024 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25378ed3f0f74744a6d304d9259db08c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36775 } }
I20260810 06:30:35.548870 29013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:35.550079 29027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25378ed3f0f74744a6d304d9259db08c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25378ed3f0f74744a6d304d9259db08c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36775 } } }
I20260810 06:30:35.550216 29027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:35.550591 29028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25378ed3f0f74744a6d304d9259db08c. Latest consensus state: current_term: 1 leader_uuid: "25378ed3f0f74744a6d304d9259db08c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25378ed3f0f74744a6d304d9259db08c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36775 } } }
I20260810 06:30:35.550824 29038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:35.550940 29028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:35.554582 29038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:35.560932 29038 catalog_manager.cc:1347] Generated new cluster ID: 7ba40b0b495a4f15adf9ec8c2d8a9260
I20260810 06:30:35.561031 29038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:35.569047 29038 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:35.570552 29038 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:35.581598 29038 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c: Generated new TSK 0
I20260810 06:30:35.582460 29038 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:35.623215 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:36775
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:35.750833 29060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:35.751199 29060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:35.751267 29060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:35.755561 29060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:35.755656 29060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:35.755746 29060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:35.761562 29060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:36775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:35.762889 29060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:35.764075 29060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:35.775017 29067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:35.775069 29060 server_base.cc:1034] running on GCE node
W20260810 06:30:35.775009 29066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:35.775009 29072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:35.775794 29060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:35.776564 29060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:35.777732 29060 hybrid_clock.cc:648] HybridClock initialized: now 1786343435777710 us; error 39 us; skew 500 ppm
Aug 10 06:30:35 dist-test-slave-7lbf krb5kdc[28888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343435, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:35.780855 29060 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:35.781809 29060 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:35.781898 29060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:35.782148 29060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:35.784514 29060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "dd06dfefdfbc47bc84051d99aabfddb6"
format_stamp: "Formatted at 2026-08-10 06:30:35 on dist-test-slave-7lbf"
server_key: "9e89101f0208d50b2e071ae511c0a9c2"
server_key_iv: "b87e54196015c4116253375a694c1728"
server_key_version: "encryptionkey@0"
I20260810 06:30:35.785192 29060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "dd06dfefdfbc47bc84051d99aabfddb6"
format_stamp: "Formatted at 2026-08-10 06:30:35 on dist-test-slave-7lbf"
server_key: "9e89101f0208d50b2e071ae511c0a9c2"
server_key_iv: "b87e54196015c4116253375a694c1728"
server_key_version: "encryptionkey@0"
I20260810 06:30:35.789726 29060 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260810 06:30:35.792562 29084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:35.794049 29060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:35.794195 29060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "dd06dfefdfbc47bc84051d99aabfddb6"
format_stamp: "Formatted at 2026-08-10 06:30:35 on dist-test-slave-7lbf"
server_key: "9e89101f0208d50b2e071ae511c0a9c2"
server_key_iv: "b87e54196015c4116253375a694c1728"
server_key_version: "encryptionkey@0"
I20260810 06:30:35.794324 29060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:35.812937 29060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:35.816694 29060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:35.816908 29060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:35.817642 29060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:35.818635 29060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:35.818691 29060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:35.818747 29060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:35.818776 29060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:35.827929 29060 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:37951
I20260810 06:30:35.827975 29267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:37951 every 8 connection(s)
I20260810 06:30:35.828768 29060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:35.831998 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 29060
I20260810 06:30:35.832142 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:35.832484 22287 external_mini_cluster.cc:1428] Setting key b4a33a352822ff21042d30cf3bea83e8
Aug 10 06:30:35 dist-test-slave-7lbf krb5kdc[28888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343435, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:35.845234 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:35.831163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:60601 (local address 127.21.195.254:36775)
0810 06:30:35.831336 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:35.831341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:35.832794 (+ 1453us) server_negotiation.cc:407] Connection header received
0810 06:30:35.833889 (+ 1095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:35.833892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:35.833942 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:35.834017 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:35.835337 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:35.836115 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:35.837835 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:35.838184 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:35.838290 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:35.841193 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:35.841198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:35.841202 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:35.841241 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:35.842885 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:35.843492 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:35.843496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:35.843498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:35.843611 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:35.843980 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:35.843984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:35.843986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:35.844251 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:35.844358 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:35.844942 (+ 584us) server_negotiation.cc:299] Negotiation successful
0810 06:30:35.845092 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:30:35.846393 29273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:35.831657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:36775 (local address 127.21.195.193:60601)
0810 06:30:35.832623 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:35.832672 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:35.833673 (+ 1001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:35.834203 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:35.834212 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:35.834625 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:35.835168 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:35.835184 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:35.836255 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:35.836259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:35.837708 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:35.837719 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:35.838337 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:35.838339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:35.838524 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:35.839151 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:35.839170 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:35.840952 (+ 1782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:35.843031 (+ 2079us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:35.843038 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:35.843058 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:35.843369 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:35.843712 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:35.843714 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:35.843716 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:35.843883 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:35.844360 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:35.844367 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:35.844702 (+ 335us) client_negotiation.cc:769] Sending connection context
0810 06:30:35.844896 (+ 194us) client_negotiation.cc:240] Negotiation successful
0810 06:30:35.845294 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":184,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:35.848143 29268 heartbeater.cc:347] Connected to a master server at 127.21.195.254:36775
I20260810 06:30:35.848479 29268 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:35.849066 29268 heartbeater.cc:511] Master 127.21.195.254:36775 requested a full tablet report, sending...
I20260810 06:30:35.851197 28965 ts_manager.cc:194] Registered new tserver with Master: dd06dfefdfbc47bc84051d99aabfddb6 (127.21.195.193:37951)
I20260810 06:30:35.852514 28965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:60601
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:35.864018 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:36775
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:35.988381 29277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:35.988708 29277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:35.988762 29277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:35.993212 29277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:35.993302 29277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:35.993372 29277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:35.999332 29277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:36775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:36.000605 29277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:36.001858 29277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:36.012552 29287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:36.012554 29289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:36.012552 29291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:36.012909 29277 server_base.cc:1034] running on GCE node
I20260810 06:30:36.013389 29277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:36.014142 29277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:36.015342 29277 hybrid_clock.cc:648] HybridClock initialized: now 1786343436015309 us; error 42 us; skew 500 ppm
Aug 10 06:30:36 dist-test-slave-7lbf krb5kdc[28888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343436, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:36.018613 29277 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:36.019485 29277 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:36.019564 29277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:36.019794 29277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:36.022285 29277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "3f58227558ec416b9381daeec3e681a6"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "c1465806946a2a70d7a744f1c2d56175"
server_key_iv: "99ead739f006f22835fd159bea0f5d48"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.022923 29277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "3f58227558ec416b9381daeec3e681a6"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "c1465806946a2a70d7a744f1c2d56175"
server_key_iv: "99ead739f006f22835fd159bea0f5d48"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.027247 29277 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:36.030164 29298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:36.031689 29277 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:36.031847 29277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "3f58227558ec416b9381daeec3e681a6"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "c1465806946a2a70d7a744f1c2d56175"
server_key_iv: "99ead739f006f22835fd159bea0f5d48"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.032001 29277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:36.048341 29277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:36.052062 29277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:36.052299 29277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:36.052980 29277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:36.053967 29277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:36.054023 29277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:36.054067 29277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:36.054088 29277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:36.063318 29277 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:35081
I20260810 06:30:36.063334 29482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:35081 every 8 connection(s)
I20260810 06:30:36.064034 29277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:36.072757 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 29277
I20260810 06:30:36.072902 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:36.073627 22287 external_mini_cluster.cc:1428] Setting key eb6c722cbe40005afd8d6edbe8ff4b5f
Aug 10 06:30:36 dist-test-slave-7lbf krb5kdc[28888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343436, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:36.079258 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.066103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:53159 (local address 127.21.195.254:36775)
0810 06:30:36.066273 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.066278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.067335 (+ 1057us) server_negotiation.cc:407] Connection header received
0810 06:30:36.068705 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.068708 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.068771 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.068874 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:36.070308 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.070897 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.072093 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.072307 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.072385 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.075433 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:36.075436 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:36.075438 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:36.075468 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:36.076942 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:36.077565 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:36.077568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:36.077569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:36.077657 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:36.078028 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:36.078032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:36.078034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:36.078239 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:36.078334 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.078929 (+ 595us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.079085 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 06:30:36.080297 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.066602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:36775 (local address 127.21.195.194:53159)
0810 06:30:36.067161 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.067213 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:36.068443 (+ 1230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:36.069076 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:36.069084 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:36.069509 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:36.070134 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.070152 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.071031 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.071034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.071992 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.072003 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.072437 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.072440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.072659 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.073357 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:36.073380 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:36.075243 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:36.077080 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:36.077088 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:36.077110 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:36.077428 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:36.077754 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:36.077758 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:36.077760 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:36.077932 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:36.078357 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:36.078365 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:36.078664 (+ 299us) client_negotiation.cc:769] Sending connection context
0810 06:30:36.078866 (+ 202us) client_negotiation.cc:240] Negotiation successful
0810 06:30:36.079247 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":138,"threads_started":1}
I20260810 06:30:36.081836 29483 heartbeater.cc:347] Connected to a master server at 127.21.195.254:36775
I20260810 06:30:36.082140 29483 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:36.082695 29483 heartbeater.cc:511] Master 127.21.195.254:36775 requested a full tablet report, sending...
I20260810 06:30:36.084035 28965 ts_manager.cc:194] Registered new tserver with Master: 3f58227558ec416b9381daeec3e681a6 (127.21.195.194:35081)
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:30:36.084869 28965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:53159
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:36.103011 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:36775
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:36.228328 29494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:36.228682 29494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:36.228731 29494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:36.233157 29494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:36.233254 29494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:36.233320 29494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:36.239415 29494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:36775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:36.240731 29494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:36.241923 29494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:36.252720 29511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:36.252720 29507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:36.252720 29506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:36.252970 29494 server_base.cc:1034] running on GCE node
I20260810 06:30:36.253470 29494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:36.254267 29494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:36.255470 29494 hybrid_clock.cc:648] HybridClock initialized: now 1786343436255448 us; error 44 us; skew 500 ppm
Aug 10 06:30:36 dist-test-slave-7lbf krb5kdc[28888](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343436, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:36.258680 29494 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:36.259519 29494 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:36.259593 29494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:36.259789 29494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:36.262169 29494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "c37a8c6cb5e04013a7093f35b040e081"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "d4ecdc4feae80c945820bd7b573898d2"
server_key_iv: "5239147a3fa5119b6c07390f155d9f01"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.262784 29494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "c37a8c6cb5e04013a7093f35b040e081"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "d4ecdc4feae80c945820bd7b573898d2"
server_key_iv: "5239147a3fa5119b6c07390f155d9f01"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.266990 29494 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:36.269754 29520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:36.271219 29494 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:36.271353 29494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "c37a8c6cb5e04013a7093f35b040e081"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "d4ecdc4feae80c945820bd7b573898d2"
server_key_iv: "5239147a3fa5119b6c07390f155d9f01"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.271490 29494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:36.289784 29494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:36.293135 29494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:36.293344 29494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:36.294075 29494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:36.295120 29494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:36.295177 29494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:36.295228 29494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:36.295257 29494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:36.304787 29494 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:45037
I20260810 06:30:36.304804 29700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:45037 every 8 connection(s)
I20260810 06:30:36.305584 29494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:36.311756 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 29494
I20260810 06:30:36.311899 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:36.312191 22287 external_mini_cluster.cc:1428] Setting key fec6f665c0c226be720a97517d12b2f8
Aug 10 06:30:36 dist-test-slave-7lbf krb5kdc[28888](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343436, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:36.320333 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.307612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:59629 (local address 127.21.195.254:36775)
0810 06:30:36.307762 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.307766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.308771 (+ 1005us) server_negotiation.cc:407] Connection header received
0810 06:30:36.310177 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.310181 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.310237 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.310315 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:36.311741 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.312381 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.313749 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.314017 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.314105 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.316905 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:36.316909 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:36.316911 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:36.316943 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:36.318308 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:36.318861 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:36.318864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:36.318866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:36.318968 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:36.319281 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:36.319283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:36.319284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:36.319489 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:36.319564 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.320068 (+ 504us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.320194 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:30:36.321280 29703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.308073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:36775 (local address 127.21.195.195:59629)
0810 06:30:36.308586 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.308637 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:36.309924 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:36.310520 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:36.310531 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:36.310970 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:36.311558 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.311575 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.312528 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.312531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.313633 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.313646 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.314183 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.314188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.314398 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.315049 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:36.315072 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:36.316703 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:36.318432 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:36.318438 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:36.318456 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:36.318763 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:36.319045 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:36.319047 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:36.319049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:36.319210 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:36.319564 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:36.319570 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:36.319858 (+ 288us) client_negotiation.cc:769] Sending connection context
0810 06:30:36.320033 (+ 175us) client_negotiation.cc:240] Negotiation successful
0810 06:30:36.320338 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":126,"threads_started":1}
I20260810 06:30:36.322593 29701 heartbeater.cc:347] Connected to a master server at 127.21.195.254:36775
I20260810 06:30:36.322878 29701 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:36.323429 29701 heartbeater.cc:511] Master 127.21.195.254:36775 requested a full tablet report, sending...
I20260810 06:30:36.324645 28965 ts_manager.cc:194] Registered new tserver with Master: c37a8c6cb5e04013a7093f35b040e081 (127.21.195.195:45037)
I20260810 06:30:36.325309 28965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:59629
I20260810 06:30:36.326511 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:30:36.336308 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.328524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47570 (local address 127.21.195.254:36775)
0810 06:30:36.328713 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.328718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.328870 (+ 152us) server_negotiation.cc:407] Connection header received
0810 06:30:36.329019 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.329023 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.329070 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.329132 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:36.329983 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.330546 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.331433 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.331666 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.331769 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.333123 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:36.333127 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:36.333130 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:36.333157 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:36.334472 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:36.334901 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:36.334905 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:36.334907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:36.335000 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:36.335265 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:36.335268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:36.335270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:36.335518 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:36.335653 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.336001 (+ 348us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.336137 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 06:30:36.339537 28965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47570:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:36.342819 28965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:36.359488 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.353278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55364 (local address 127.21.195.195:45037)
0810 06:30:36.353830 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.353845 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.354158 (+ 313us) server_negotiation.cc:407] Connection header received
0810 06:30:36.354257 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.354263 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.354511 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.354675 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:36.355214 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.356106 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.357819 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.358702 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.358847 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.359036 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.359203 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.359317 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":190,"threads_started":1}
I20260810 06:30:36.359479 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.353970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:37951 (local address 127.0.0.1:33488)
0810 06:30:36.354422 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.354436 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:36.354537 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:36.355242 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:36.355244 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:36.355263 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:36.355336 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.355341 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.356670 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.356674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.357799 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.357811 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.358859 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.358863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.358985 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.359023 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 06:30:36.359121 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 06:30:36.359300 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"mutex_wait_us":139,"thread_start_us":96,"threads_started":1}
I20260810 06:30:36.359645 29717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.353310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:35081 (local address 127.0.0.1:56258)
0810 06:30:36.353971 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.353984 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:36.354072 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:36.354853 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:36.354860 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:36.354896 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:36.355117 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.355124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.356670 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.356674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.358289 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.358298 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.359268 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.359272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.359351 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.359373 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 06:30:36.359420 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 06:30:36.359496 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"mutex_wait_us":710,"spinlock_wait_cycles":2944,"thread_start_us":127,"threads_started":1}
I20260810 06:30:36.359973 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.354368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33488 (local address 127.21.195.193:37951)
0810 06:30:36.354757 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.354763 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.354784 (+ 21us) server_negotiation.cc:407] Connection header received
0810 06:30:36.354860 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.354865 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.355081 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.355287 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:36.355436 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.356539 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.357947 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.358728 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.359279 (+ 551us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.359445 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.359500 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.359849 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":80,"threads_started":1}
I20260810 06:30:36.360503 29721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.353778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56258 (local address 127.21.195.194:35081)
0810 06:30:36.354393 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.354404 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.354436 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:30:36.354509 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.354513 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.354693 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.354846 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:36.355262 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.356504 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.358422 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.359138 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.360017 (+ 879us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.360167 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.360224 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.360332 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":112,"threads_started":1}
I20260810 06:30:36.360544 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.353097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45037 (local address 127.0.0.1:55364)
0810 06:30:36.353754 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.353813 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:36.353986 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:36.354859 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:36.354862 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:36.354900 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:36.355086 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.355094 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.356276 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.356281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.357693 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.357705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.358839 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.358843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.358973 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.359022 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 06:30:36.359160 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 06:30:36.360417 (+ 1257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":8,"spinlock_wait_cycles":5376,"thread_start_us":91,"threads_started":1}
I20260810 06:30:36.363205 29158 tablet_service.cc:1467] Processing CreateTablet for tablet dab0f274b2f14b5589f129a64812dcbb (DEFAULT_TABLE table=test-table [id=07c8f494a37a47018e94586aa8a98b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:36.363519 29595 tablet_service.cc:1467] Processing CreateTablet for tablet dab0f274b2f14b5589f129a64812dcbb (DEFAULT_TABLE table=test-table [id=07c8f494a37a47018e94586aa8a98b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:36.364411 29158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab0f274b2f14b5589f129a64812dcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:36.364766 29595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab0f274b2f14b5589f129a64812dcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:36.364377 29377 tablet_service.cc:1467] Processing CreateTablet for tablet dab0f274b2f14b5589f129a64812dcbb (DEFAULT_TABLE table=test-table [id=07c8f494a37a47018e94586aa8a98b88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:36.365478 29377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab0f274b2f14b5589f129a64812dcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:36.371446 29725 tablet_bootstrap.cc:492] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6: Bootstrap starting.
I20260810 06:30:36.373103 29727 tablet_bootstrap.cc:492] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Bootstrap starting.
I20260810 06:30:36.373919 29726 tablet_bootstrap.cc:492] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Bootstrap starting.
I20260810 06:30:36.374462 29725 tablet_bootstrap.cc:654] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:36.375600 29727 tablet_bootstrap.cc:654] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:36.376062 29726 tablet_bootstrap.cc:654] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:36.375703 29725 log.cc:824] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:36.377029 29727 log.cc:824] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:36.377369 29726 log.cc:824] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:36.378813 29725 tablet_bootstrap.cc:492] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6: No bootstrap required, opened a new log
I20260810 06:30:36.379063 29725 ts_tablet_manager.cc:1397] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 06:30:36.379155 29727 tablet_bootstrap.cc:492] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: No bootstrap required, opened a new log
I20260810 06:30:36.379366 29727 ts_tablet_manager.cc:1397] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:30:36.379477 29726 tablet_bootstrap.cc:492] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: No bootstrap required, opened a new log
I20260810 06:30:36.379675 29726 ts_tablet_manager.cc:1397] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:30:36.382575 29727 raft_consensus.cc:348] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.383092 29727 raft_consensus.cc:374] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:36.383211 29727 raft_consensus.cc:729] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f58227558ec416b9381daeec3e681a6, State: Initialized, Role: FOLLOWER
I20260810 06:30:36.383755 29727 consensus_queue.cc:260] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.383664 29726 raft_consensus.cc:348] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.384032 29726 raft_consensus.cc:374] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:36.384100 29726 raft_consensus.cc:729] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37a8c6cb5e04013a7093f35b040e081, State: Initialized, Role: FOLLOWER
I20260810 06:30:36.384573 29483 heartbeater.cc:503] Master 127.21.195.254:36775 was elected leader, sending a full tablet report...
I20260810 06:30:36.384539 29725 raft_consensus.cc:348] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.384817 29725 raft_consensus.cc:374] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:36.384865 29725 raft_consensus.cc:729] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd06dfefdfbc47bc84051d99aabfddb6, State: Initialized, Role: FOLLOWER
I20260810 06:30:36.384886 29727 ts_tablet_manager.cc:1428] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 06:30:36.385324 29725 consensus_queue.cc:260] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.386154 29268 heartbeater.cc:503] Master 127.21.195.254:36775 was elected leader, sending a full tablet report...
I20260810 06:30:36.386231 29726 consensus_queue.cc:260] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.387234 29701 heartbeater.cc:503] Master 127.21.195.254:36775 was elected leader, sending a full tablet report...
I20260810 06:30:36.387380 29726 ts_tablet_manager.cc:1428] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Time spent starting tablet: real 0.008s user 0.001s sys 0.005s
I20260810 06:30:36.388746 29725 ts_tablet_manager.cc:1428] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260810 06:30:36.528249 29736 raft_consensus.cc:482] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:36.528518 29736 raft_consensus.cc:504] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.530022 29736 leader_election.cc:288] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c37a8c6cb5e04013a7093f35b040e081 (127.21.195.195:45037), dd06dfefdfbc47bc84051d99aabfddb6 (127.21.195.193:37951)
I20260810 06:30:36.534492 29488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.530310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45037 (local address 127.21.195.194:36223)
0810 06:30:36.530453 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.530468 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:36.530589 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:36.530987 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:36.530990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:36.531010 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:36.531131 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.531137 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.532043 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.532046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.533070 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.533083 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.534023 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.534027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.534139 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.534165 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 06:30:36.534245 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 06:30:36.534326 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":23}
I20260810 06:30:36.534492 29720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.530396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:36223 (local address 127.21.195.195:45037)
0810 06:30:36.530556 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.530561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.530579 (+ 18us) server_negotiation.cc:407] Connection header received
0810 06:30:36.530727 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.530731 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.530781 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.530848 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:36.531251 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.531934 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.533205 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.533898 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.534023 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.534079 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.534276 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.534362 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:30:36.534931 29744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.530655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:37951 (local address 127.21.195.194:36921)
0810 06:30:36.531042 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.531054 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:36.531153 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:36.531497 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:36.531500 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:36.531520 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:36.531646 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.531652 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.532634 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.532638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.533635 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:36.533644 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.534469 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.534472 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:36.534574 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.534598 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 06:30:36.534721 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:30:36.534795 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":21,"thread_start_us":100,"threads_started":1}
I20260810 06:30:36.534978 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.530829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:36921 (local address 127.21.195.193:37951)
0810 06:30:36.530958 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.530962 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.531128 (+ 166us) server_negotiation.cc:407] Connection header received
0810 06:30:36.531341 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.531346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.531401 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.531470 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:36.531750 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.532505 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.533762 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.534332 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.534451 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.534501 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.534766 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.534861 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:30:36.535318 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab0f274b2f14b5589f129a64812dcbb" candidate_uuid: "3f58227558ec416b9381daeec3e681a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a8c6cb5e04013a7093f35b040e081" is_pre_election: true
I20260810 06:30:36.535708 29629 raft_consensus.cc:2454] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f58227558ec416b9381daeec3e681a6 in term 0.
I20260810 06:30:36.536089 29189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab0f274b2f14b5589f129a64812dcbb" candidate_uuid: "3f58227558ec416b9381daeec3e681a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" is_pre_election: true
I20260810 06:30:36.536309 29301 leader_election.cc:302] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f58227558ec416b9381daeec3e681a6, c37a8c6cb5e04013a7093f35b040e081; no voters:
I20260810 06:30:36.536445 29189 raft_consensus.cc:2454] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f58227558ec416b9381daeec3e681a6 in term 0.
I20260810 06:30:36.536636 29736 raft_consensus.cc:2781] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:36.536732 29736 raft_consensus.cc:482] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:36.536787 29736 raft_consensus.cc:3037] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:36.538039 29736 raft_consensus.cc:504] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.538463 29736 leader_election.cc:288] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [CANDIDATE]: Term 1 election: Requested vote from peers c37a8c6cb5e04013a7093f35b040e081 (127.21.195.195:45037), dd06dfefdfbc47bc84051d99aabfddb6 (127.21.195.193:37951)
I20260810 06:30:36.538944 29189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab0f274b2f14b5589f129a64812dcbb" candidate_uuid: "3f58227558ec416b9381daeec3e681a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd06dfefdfbc47bc84051d99aabfddb6"
I20260810 06:30:36.538944 29629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab0f274b2f14b5589f129a64812dcbb" candidate_uuid: "3f58227558ec416b9381daeec3e681a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c37a8c6cb5e04013a7093f35b040e081"
I20260810 06:30:36.539084 29629 raft_consensus.cc:3037] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:36.539084 29189 raft_consensus.cc:3037] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:36.540464 29629 raft_consensus.cc:2454] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f58227558ec416b9381daeec3e681a6 in term 1.
I20260810 06:30:36.540464 29189 raft_consensus.cc:2454] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f58227558ec416b9381daeec3e681a6 in term 1.
I20260810 06:30:36.540796 29301 leader_election.cc:302] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f58227558ec416b9381daeec3e681a6, c37a8c6cb5e04013a7093f35b040e081; no voters:
I20260810 06:30:36.540968 29736 raft_consensus.cc:2781] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:36.541205 29736 raft_consensus.cc:686] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 1 LEADER]: Becoming Leader. State: Replica: 3f58227558ec416b9381daeec3e681a6, State: Running, Role: LEADER
I20260810 06:30:36.541615 29736 consensus_queue.cc:237] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } }
I20260810 06:30:36.545418 28965 catalog_manager.cc:5495] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f58227558ec416b9381daeec3e681a6 (127.21.195.194). New cstate: current_term: 1 leader_uuid: "3f58227558ec416b9381daeec3e681a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f58227558ec416b9381daeec3e681a6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 } health_report { overall_health: UNKNOWN } } }
W20260810 06:30:36.556619 29702 tablet.cc:2369] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:36.565284 29486 tablet.cc:2369] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:36.580214 29271 tablet.cc:2369] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:30:36.597298 29721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.593863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56272 (local address 127.21.195.194:35081)
0810 06:30:36.593990 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.593994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.594008 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:30:36.594097 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.594099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.594158 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.594250 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:36.594454 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.594973 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.595826 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:36.596048 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:36.596127 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:36.596373 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:36.596898 (+ 525us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:36.596990 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.597076 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.597141 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:30:36.604365 29189 raft_consensus.cc:1261] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 1 FOLLOWER]: Refusing update from remote peer 3f58227558ec416b9381daeec3e681a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:36.604365 29629 raft_consensus.cc:1261] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 1 FOLLOWER]: Refusing update from remote peer 3f58227558ec416b9381daeec3e681a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:36.605242 29736 consensus_queue.cc:1035] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd06dfefdfbc47bc84051d99aabfddb6" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:36.605489 29745 consensus_queue.cc:1035] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c37a8c6cb5e04013a7093f35b040e081" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:36.614230 29751 mvcc.cc:205] Tried to move back new op lower bound from 7316862716322467840 to 7316862716078047232. Current Snapshot: MvccSnapshot[applied={T|T < 7316862716322467840}]
I20260810 06:30:36.623394 28965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:36.623605 28965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47570:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:36.626420 28965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25378ed3f0f74744a6d304d9259db08c: Sending DeleteTablet for 3 replicas of tablet dab0f274b2f14b5589f129a64812dcbb
I20260810 06:30:36.627347 29377 tablet_service.cc:1514] Processing DeleteTablet for tablet dab0f274b2f14b5589f129a64812dcbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:36 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:56258
I20260810 06:30:36.627444 29595 tablet_service.cc:1514] Processing DeleteTablet for tablet dab0f274b2f14b5589f129a64812dcbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:36 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:55364
I20260810 06:30:36.627668 29158 tablet_service.cc:1514] Processing DeleteTablet for tablet dab0f274b2f14b5589f129a64812dcbb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:36 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:33488
I20260810 06:30:36.628262 29770 tablet_replica.cc:330] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: stopping tablet replica
I20260810 06:30:36.628288 29771 tablet_replica.cc:330] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6: stopping tablet replica
I20260810 06:30:36.628665 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 29060
I20260810 06:30:36.628669 29771 raft_consensus.cc:2229] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:36.628669 29770 raft_consensus.cc:2229] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:36.629030 29771 raft_consensus.cc:2258] T dab0f274b2f14b5589f129a64812dcbb P dd06dfefdfbc47bc84051d99aabfddb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:36.629096 29770 raft_consensus.cc:2258] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:36.632966 29770 ts_tablet_manager.cc:1905] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:36.633808 29769 tablet_replica.cc:330] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: stopping tablet replica
I20260810 06:30:36.634178 29769 raft_consensus.cc:2229] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:36.634588 29769 raft_consensus.cc:2258] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:36.638275 29770 ts_tablet_manager.cc:1918] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:36.638419 29770 log.cc:1196] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/dab0f274b2f14b5589f129a64812dcbb
I20260810 06:30:36.638804 29770 ts_tablet_manager.cc:1939] T dab0f274b2f14b5589f129a64812dcbb P 3f58227558ec416b9381daeec3e681a6: Deleting consensus metadata
I20260810 06:30:36.640333 28941 catalog_manager.cc:4841] TS 3f58227558ec416b9381daeec3e681a6 (127.21.195.194:35081): tablet dab0f274b2f14b5589f129a64812dcbb (table test-table [id=07c8f494a37a47018e94586aa8a98b88]) successfully deleted
I20260810 06:30:36.646687 29769 ts_tablet_manager.cc:1905] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:36.650138 29769 ts_tablet_manager.cc:1918] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:36.650285 29769 log.cc:1196] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/dab0f274b2f14b5589f129a64812dcbb
I20260810 06:30:36.650760 29769 ts_tablet_manager.cc:1939] T dab0f274b2f14b5589f129a64812dcbb P c37a8c6cb5e04013a7093f35b040e081: Deleting consensus metadata
W20260810 06:30:36.651189 28943 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:37951 (error 108)
I20260810 06:30:36.652374 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.652061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:37951 (local address 127.0.0.1:33490)
0810 06:30:36.652199 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.652276 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:37951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 06:30:36.652384 28943 catalog_manager.cc:4841] TS c37a8c6cb5e04013a7093f35b040e081 (127.21.195.195:45037): tablet dab0f274b2f14b5589f129a64812dcbb (table test-table [id=07c8f494a37a47018e94586aa8a98b88]) successfully deleted
I20260810 06:30:36.652575 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 29277
W20260810 06:30:36.652731 28943 catalog_manager.cc:4584] TS dd06dfefdfbc47bc84051d99aabfddb6 (127.21.195.193:37951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dab0f274b2f14b5589f129a64812dcbb: Network error: Client connection negotiation failed: client connection to 127.21.195.193:37951: connect: Connection refused (error 111)
I20260810 06:30:36.668676 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 29494
I20260810 06:30:36.706955 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.706466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:37951 (local address 127.0.0.1:33496)
0810 06:30:36.706741 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.706831 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:37951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169}
I20260810 06:30:36.708200 29719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.707831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:37951 (local address 127.0.0.1:33500)
0810 06:30:36.708036 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:36.708104 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:37951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260810 06:30:36.715281 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 28914
2026-08-10T06:30:36Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4257 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T06:30:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:36Z Disabled control of system clock
I20260810 06:30:36.762871 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:42521
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:42521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 06:30:36.892230 29783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:36.892608 29783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:36.892652 29783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:36.896880 29783 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:36.896974 29783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:36.896988 29783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:36.897004 29783 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:36.897018 29783 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:36.902395 29783 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:42521
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:42521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:36.903921 29783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:36.905489 29783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:36.914788 29788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:36.914781 29794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:36.915118 29783 server_base.cc:1034] running on GCE node
W20260810 06:30:36.914781 29790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:36.915901 29783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:36.917138 29783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:36.918330 29783 hybrid_clock.cc:648] HybridClock initialized: now 1786343436918290 us; error 51 us; skew 500 ppm
I20260810 06:30:36.920426 29783 webserver.cc:460] Webserver started at http://127.21.195.254:45179/ using document root <none> and password file <none>
I20260810 06:30:36.921047 29783 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:36.921116 29783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:36.921314 29783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:36.923683 29783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "1f716fb9fa48442d806b649bfc001aba"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "bae217ffa2137d83dc7196e50d008b38"
server_key_iv: "ac7efeabea07d4fe3cd08e7035afcbbb"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.924295 29783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "1f716fb9fa48442d806b649bfc001aba"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "bae217ffa2137d83dc7196e50d008b38"
server_key_iv: "ac7efeabea07d4fe3cd08e7035afcbbb"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.928448 29783 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:30:36.931252 29802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:36.932646 29783 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260810 06:30:36.932778 29783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "1f716fb9fa48442d806b649bfc001aba"
format_stamp: "Formatted at 2026-08-10 06:30:36 on dist-test-slave-7lbf"
server_key: "bae217ffa2137d83dc7196e50d008b38"
server_key_iv: "ac7efeabea07d4fe3cd08e7035afcbbb"
server_key_version: "encryptionkey@0"
I20260810 06:30:36.932899 29783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:36.937979 29783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:36.938657 29783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:36.938817 29783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:36.945840 29783 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:42521
I20260810 06:30:36.945858 29878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:42521 every 8 connection(s)
I20260810 06:30:36.946945 29783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:36.950775 29883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:36.954676 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 29783
I20260810 06:30:36.954826 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:36.955149 22287 external_mini_cluster.cc:1428] Setting key 90c83dd5883957a9f65bbccf272aa112
I20260810 06:30:36.957929 29883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba: Bootstrap starting.
I20260810 06:30:36.960776 29883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:36.961596 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:36.956798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35106 (local address 127.21.195.254:42521)
0810 06:30:36.957571 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:36.957595 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:36.957639 (+ 44us) server_negotiation.cc:407] Connection header received
0810 06:30:36.958393 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:36.958419 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:36.958838 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:36.959164 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:36.960078 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:36.960083 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:36.960099 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:36.960110 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:36.960173 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:36.960189 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:36.960283 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:36.960418 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 06:30:36.960699 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":130,"threads_started":1}
I20260810 06:30:36.961661 29883 log.cc:824] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:36.964186 29883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba: No bootstrap required, opened a new log
I20260810 06:30:36.968132 29883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f716fb9fa48442d806b649bfc001aba" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42521 } }
I20260810 06:30:36.968415 29883 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:36.968479 29883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f716fb9fa48442d806b649bfc001aba, State: Initialized, Role: FOLLOWER
I20260810 06:30:36.968935 29883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f716fb9fa48442d806b649bfc001aba" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42521 } }
I20260810 06:30:36.969074 29883 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:36.969142 29883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:36.969252 29883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:36.970418 29883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f716fb9fa48442d806b649bfc001aba" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42521 } }
I20260810 06:30:36.970820 29883 leader_election.cc:302] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f716fb9fa48442d806b649bfc001aba; no voters:
I20260810 06:30:36.971168 29883 leader_election.cc:288] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:36.971276 29895 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:36.971500 29895 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [term 1 LEADER]: Becoming Leader. State: Replica: 1f716fb9fa48442d806b649bfc001aba, State: Running, Role: LEADER
I20260810 06:30:36.971894 29895 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f716fb9fa48442d806b649bfc001aba" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42521 } }
I20260810 06:30:36.972532 29883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:36.973659 29901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f716fb9fa48442d806b649bfc001aba. Latest consensus state: current_term: 1 leader_uuid: "1f716fb9fa48442d806b649bfc001aba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f716fb9fa48442d806b649bfc001aba" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42521 } } }
I20260810 06:30:36.973799 29901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:36.974192 29912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:36.974154 29897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f716fb9fa48442d806b649bfc001aba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f716fb9fa48442d806b649bfc001aba" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42521 } } }
I20260810 06:30:36.974531 29897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:36.977842 29912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:36.984421 29912 catalog_manager.cc:1347] Generated new cluster ID: 8b9031bcf83e41d38e5621d2ad0335fb
I20260810 06:30:36.984611 29912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:37.009702 29912 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:37.010095 29912 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:37.016603 29912 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba: Generated new TSK 0
I20260810 06:30:37.017434 29912 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:30:37.028515 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:42521
--builtin_ntp_servers=127.21.195.212:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 06:30:37.163257 29929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:37.163594 29929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:37.163637 29929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:37.167867 29929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:37.167945 29929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:37.168007 29929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:37.173156 29929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:37.174525 29929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:37.176101 29929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:37.186733 29941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:37.186725 29936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:37.186725 29935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:37.187039 29929 server_base.cc:1034] running on GCE node
I20260810 06:30:37.187525 29929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:37.188274 29929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:37.189441 29929 hybrid_clock.cc:648] HybridClock initialized: now 1786343437189417 us; error 37 us; skew 500 ppm
I20260810 06:30:37.191601 29929 webserver.cc:460] Webserver started at http://127.21.195.193:40447/ using document root <none> and password file <none>
I20260810 06:30:37.192230 29929 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:37.192304 29929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:37.192530 29929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:37.194916 29929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "22089afe1d50434f9839abf27e51228b"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "9777e4246beba3dde9f53fe8feb40584"
server_key_iv: "7b64e864dd992bb44f22a3b42f1b5f4c"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.195551 29929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "22089afe1d50434f9839abf27e51228b"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "9777e4246beba3dde9f53fe8feb40584"
server_key_iv: "7b64e864dd992bb44f22a3b42f1b5f4c"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.199920 29929 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:37.202925 29954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.204322 29929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:37.204456 29929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "22089afe1d50434f9839abf27e51228b"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "9777e4246beba3dde9f53fe8feb40584"
server_key_iv: "7b64e864dd992bb44f22a3b42f1b5f4c"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.204588 29929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:37.209800 29929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:37.210587 29929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:37.210774 29929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:37.211396 29929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:37.212525 29929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:37.212577 29929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.212637 29929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:37.212662 29929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.221685 29929 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:45181
I20260810 06:30:37.221745 30150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:45181 every 8 connection(s)
I20260810 06:30:37.222724 29929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:37.227659 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 29929
I20260810 06:30:37.227800 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:37.228130 22287 external_mini_cluster.cc:1428] Setting key bd5dce0e41c189f7c3df15c2d49e2fae
I20260810 06:30:37.229640 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.224804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:54343 (local address 127.21.195.254:42521)
0810 06:30:37.224971 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.224975 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.226218 (+ 1243us) server_negotiation.cc:407] Connection header received
0810 06:30:37.227667 (+ 1449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.227669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.227712 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.227789 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.229124 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.229128 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.229130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.229144 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.229169 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.229179 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.229265 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.229378 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.229421 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 06:30:37.230621 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:42521
--builtin_ntp_servers=127.21.195.212:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 06:30:37.230636 30160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.225244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:42521 (local address 127.21.195.193:54343)
0810 06:30:37.226049 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:37.226105 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:37.227419 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:37.227999 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:37.228010 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:37.228143 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:37.228801 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:30:37.228803 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:37.228865 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:30:37.228969 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:37.229262 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:37.229267 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:37.229271 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:30:37.229415 (+ 144us) client_negotiation.cc:240] Negotiation successful
0810 06:30:37.229726 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":137,"threads_started":1}
I20260810 06:30:37.232013 30151 heartbeater.cc:347] Connected to a master server at 127.21.195.254:42521
I20260810 06:30:37.232278 30151 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:37.232733 30151 heartbeater.cc:511] Master 127.21.195.254:42521 requested a full tablet report, sending...
I20260810 06:30:37.234385 29829 ts_manager.cc:194] Registered new tserver with Master: 22089afe1d50434f9839abf27e51228b (127.21.195.193:45181)
W20260810 06:30:37.352195 30161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:37.352540 30161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:37.352603 30161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:37.356833 30161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:37.356930 30161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:37.357014 30161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:37.362200 30161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:37.363507 30161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:37.365119 30161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:37.376322 30169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:37.376335 30170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:37.376322 30175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:37.376652 30161 server_base.cc:1034] running on GCE node
I20260810 06:30:37.377138 30161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:37.377946 30161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:37.379136 30161 hybrid_clock.cc:648] HybridClock initialized: now 1786343437379109 us; error 44 us; skew 500 ppm
I20260810 06:30:37.381211 30161 webserver.cc:460] Webserver started at http://127.21.195.194:33211/ using document root <none> and password file <none>
I20260810 06:30:37.381925 30161 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:37.382009 30161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:37.382256 30161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:37.384586 30161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "d54e1054eb174195b46531406e9cc8f9"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "c0e3ad8f9449d0b2c5ac6d99825e7775"
server_key_iv: "fd1ce45f2d63c2e75980cdaca25a130e"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.385284 30161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "d54e1054eb174195b46531406e9cc8f9"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "c0e3ad8f9449d0b2c5ac6d99825e7775"
server_key_iv: "fd1ce45f2d63c2e75980cdaca25a130e"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.389667 30161 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:30:37.392650 30185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.394140 30161 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:37.394277 30161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "d54e1054eb174195b46531406e9cc8f9"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "c0e3ad8f9449d0b2c5ac6d99825e7775"
server_key_iv: "fd1ce45f2d63c2e75980cdaca25a130e"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.394419 30161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:37.399434 30161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:37.400156 30161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:37.400332 30161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:37.400952 30161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:37.402168 30161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:37.402220 30161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.402279 30161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:37.402309 30161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.411475 30161 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:38733
I20260810 06:30:37.411501 30364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:38733 every 8 connection(s)
I20260810 06:30:37.412627 30161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:37.418244 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 30161
I20260810 06:30:37.418398 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:37.418737 22287 external_mini_cluster.cc:1428] Setting key eac987a5be63fa98ef8647b3a8745d5f
I20260810 06:30:37.419999 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.414872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:57541 (local address 127.21.195.254:42521)
0810 06:30:37.415040 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.415044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.416317 (+ 1273us) server_negotiation.cc:407] Connection header received
0810 06:30:37.417996 (+ 1679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.418000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.418047 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.418141 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.419482 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.419486 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.419488 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.419501 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.419528 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.419539 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.419642 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.419805 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.419854 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 06:30:37.421223 30370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.415350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:42521 (local address 127.21.195.194:57541)
0810 06:30:37.416154 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:37.416202 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:37.417706 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:37.418386 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:37.418397 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:37.418531 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:37.419189 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:30:37.419191 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:37.419239 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:30:37.419339 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:37.419641 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:37.419653 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:37.419660 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:30:37.419850 (+ 190us) client_negotiation.cc:240] Negotiation successful
0810 06:30:37.420157 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":123,"threads_started":1}
I20260810 06:30:37.421293 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:42521
--builtin_ntp_servers=127.21.195.212:41399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260810 06:30:37.422582 30365 heartbeater.cc:347] Connected to a master server at 127.21.195.254:42521
I20260810 06:30:37.422847 30365 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:37.423398 30365 heartbeater.cc:511] Master 127.21.195.254:42521 requested a full tablet report, sending...
I20260810 06:30:37.424678 29829 ts_manager.cc:194] Registered new tserver with Master: d54e1054eb174195b46531406e9cc8f9 (127.21.195.194:38733)
W20260810 06:30:37.546929 30371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:37.547254 30371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:37.547297 30371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:37.551604 30371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:37.551687 30371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:37.551755 30371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:37.556926 30371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:42521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:37.558272 30371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:37.559885 30371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:37.570638 30379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:37.570652 30371 server_base.cc:1034] running on GCE node
W20260810 06:30:37.570647 30382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:37.570669 30380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:37.571333 30371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:37.572079 30371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:37.573244 30371 hybrid_clock.cc:648] HybridClock initialized: now 1786343437573210 us; error 55 us; skew 500 ppm
I20260810 06:30:37.575433 30371 webserver.cc:460] Webserver started at http://127.21.195.195:36043/ using document root <none> and password file <none>
I20260810 06:30:37.576081 30371 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:37.576160 30371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:37.576395 30371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:37.578894 30371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "c4263697741844548a1730c83fa04f46"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "8c935e842587d7a771cb78acb11b4629"
server_key_iv: "df4237251cd672043b8e4825638f8aec"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.579592 30371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "c4263697741844548a1730c83fa04f46"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "8c935e842587d7a771cb78acb11b4629"
server_key_iv: "df4237251cd672043b8e4825638f8aec"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.583786 30371 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:37.586782 30395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.588197 30371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:37.588328 30371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "c4263697741844548a1730c83fa04f46"
format_stamp: "Formatted at 2026-08-10 06:30:37 on dist-test-slave-7lbf"
server_key: "8c935e842587d7a771cb78acb11b4629"
server_key_iv: "df4237251cd672043b8e4825638f8aec"
server_key_version: "encryptionkey@0"
I20260810 06:30:37.588455 30371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:37.593631 30371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:37.594368 30371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:37.594560 30371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:37.595201 30371 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:37.596252 30371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:37.596305 30371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.596365 30371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:37.596393 30371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:37.605326 30371 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:41493
I20260810 06:30:37.605374 30568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:41493 every 8 connection(s)
I20260810 06:30:37.606407 30371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:37.609616 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 30371
I20260810 06:30:37.609766 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:37.610095 22287 external_mini_cluster.cc:1428] Setting key a6b974ae0fadfd8d5be152869b316c03
I20260810 06:30:37.613497 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.608459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:46241 (local address 127.21.195.254:42521)
0810 06:30:37.608627 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.608632 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.610107 (+ 1475us) server_negotiation.cc:407] Connection header received
0810 06:30:37.611750 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.611754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.611798 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.611880 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.613051 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.613055 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.613058 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.613074 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.613100 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.613110 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.613195 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.613316 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.613355 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:30:37.614532 30575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.608962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:42521 (local address 127.21.195.195:46241)
0810 06:30:37.609892 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:37.609957 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:37.611510 (+ 1553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:37.612072 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:37.612081 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:37.612204 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:37.612757 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:30:37.612759 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:37.612806 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:30:37.612882 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:37.613189 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:37.613197 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:37.613203 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:30:37.613353 (+ 150us) client_negotiation.cc:240] Negotiation successful
0810 06:30:37.613656 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":135,"threads_started":1}
I20260810 06:30:37.615664 30571 heartbeater.cc:347] Connected to a master server at 127.21.195.254:42521
I20260810 06:30:37.615909 30571 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:37.616362 30571 heartbeater.cc:511] Master 127.21.195.254:42521 requested a full tablet report, sending...
I20260810 06:30:37.617409 29829 ts_manager.cc:194] Registered new tserver with Master: c4263697741844548a1730c83fa04f46 (127.21.195.195:41493)
I20260810 06:30:37.624143 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:30:37.627671 29889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.626203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43650 (local address 127.21.195.254:42521)
0810 06:30:37.626360 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.626364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.626487 (+ 123us) server_negotiation.cc:407] Connection header received
0810 06:30:37.626604 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.626607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.626645 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.626713 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.627322 (+ 609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.627326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.627328 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.627339 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.627360 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.627368 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.627435 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.627487 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.627525 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:30:37.630599 29829 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:37.633872 29829 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:37.646607 30592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.643281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:41493 (local address 127.0.0.1:33738)
0810 06:30:37.644213 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:37.644226 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:37.644318 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:37.644917 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:37.644925 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:37.645019 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:37.645638 (+ 619us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:30:37.645640 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:37.645665 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:30:37.645759 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:37.646209 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:37.646218 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:37.646225 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:30:37.646348 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:30:37.646428 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"thread_start_us":110,"threads_started":1}
I20260810 06:30:37.646648 30593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.643512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33738 (local address 127.21.195.195:41493)
0810 06:30:37.644066 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.644080 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.644413 (+ 333us) server_negotiation.cc:407] Connection header received
0810 06:30:37.644483 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.644490 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.644741 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.644906 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.645911 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.645919 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.645935 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.645949 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.646003 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.646054 (+ 51us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.646162 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.646382 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.646480 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":154,"threads_started":1}
I20260810 06:30:37.646767 30590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.643153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:38733 (local address 127.0.0.1:60272)
0810 06:30:37.643613 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:37.643670 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:37.643777 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:37.645296 (+ 1519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:37.645300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:37.645316 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:37.645731 (+ 415us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:30:37.645733 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:37.645744 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:30:37.645772 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:37.646520 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:37.646523 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:37.646527 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:30:37.646584 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 06:30:37.646618 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":98,"threads_started":1}
I20260810 06:30:37.647385 30594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.643955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:45181 (local address 127.0.0.1:52192)
0810 06:30:37.644607 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:37.644620 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:37.644693 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:37.645822 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:37.645826 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:37.645841 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:37.646286 (+ 445us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:30:37.646288 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:37.646298 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:30:37.646322 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:37.647167 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:37.647170 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:37.647174 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:30:37.647229 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 06:30:37.647265 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":90,"threads_started":1}
I20260810 06:30:37.647778 30595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.643928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60272 (local address 127.21.195.194:38733)
0810 06:30:37.644846 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.644859 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.644886 (+ 27us) server_negotiation.cc:407] Connection header received
0810 06:30:37.644938 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.644943 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.645138 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.645599 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.646288 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.646294 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.646307 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.646318 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.646364 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.646394 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.647320 (+ 926us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.647374 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.647625 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":804,"thread_start_us":140,"threads_started":1}
I20260810 06:30:37.648177 30597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.644383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52192 (local address 127.21.195.193:45181)
0810 06:30:37.644948 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.644961 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.644996 (+ 35us) server_negotiation.cc:407] Connection header received
0810 06:30:37.645048 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.645053 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.645235 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.646087 (+ 852us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.646938 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.646945 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.646955 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.646966 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.647023 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.647061 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.647905 (+ 844us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.647960 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.648053 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":123,"threads_started":1}
I20260810 06:30:37.650590 30259 tablet_service.cc:1467] Processing CreateTablet for tablet 2bdd05e599db4576bed78279dc117fda (DEFAULT_TABLE table=test-table [id=83d9fea6a85941e2a5dc6a781f14c7ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:37.650592 30464 tablet_service.cc:1467] Processing CreateTablet for tablet 2bdd05e599db4576bed78279dc117fda (DEFAULT_TABLE table=test-table [id=83d9fea6a85941e2a5dc6a781f14c7ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:37.650957 30034 tablet_service.cc:1467] Processing CreateTablet for tablet 2bdd05e599db4576bed78279dc117fda (DEFAULT_TABLE table=test-table [id=83d9fea6a85941e2a5dc6a781f14c7ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:37.651860 30259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bdd05e599db4576bed78279dc117fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:37.651861 30464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bdd05e599db4576bed78279dc117fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:37.651860 30034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bdd05e599db4576bed78279dc117fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:37.658792 30598 tablet_bootstrap.cc:492] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Bootstrap starting.
I20260810 06:30:37.660391 30601 tablet_bootstrap.cc:492] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b: Bootstrap starting.
I20260810 06:30:37.661633 30598 tablet_bootstrap.cc:654] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:37.661918 30600 tablet_bootstrap.cc:492] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Bootstrap starting.
I20260810 06:30:37.662483 30598 log.cc:824] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:37.662635 30601 tablet_bootstrap.cc:654] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:37.663556 30601 log.cc:824] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:37.664214 30600 tablet_bootstrap.cc:654] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:37.664718 30598 tablet_bootstrap.cc:492] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: No bootstrap required, opened a new log
I20260810 06:30:37.664927 30598 ts_tablet_manager.cc:1397] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260810 06:30:37.665076 30600 log.cc:824] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:37.665786 30601 tablet_bootstrap.cc:492] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b: No bootstrap required, opened a new log
I20260810 06:30:37.665989 30601 ts_tablet_manager.cc:1397] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:30:37.667799 30600 tablet_bootstrap.cc:492] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: No bootstrap required, opened a new log
I20260810 06:30:37.668032 30600 ts_tablet_manager.cc:1397] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:30:37.669041 30598 raft_consensus.cc:348] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.669301 30598 raft_consensus.cc:374] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:37.669363 30598 raft_consensus.cc:729] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d54e1054eb174195b46531406e9cc8f9, State: Initialized, Role: FOLLOWER
I20260810 06:30:37.669883 30598 consensus_queue.cc:260] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.670660 30365 heartbeater.cc:503] Master 127.21.195.254:42521 was elected leader, sending a full tablet report...
I20260810 06:30:37.670604 30601 raft_consensus.cc:348] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.670892 30601 raft_consensus.cc:374] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:37.670950 30601 raft_consensus.cc:729] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22089afe1d50434f9839abf27e51228b, State: Initialized, Role: FOLLOWER
I20260810 06:30:37.671077 30598 ts_tablet_manager.cc:1428] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260810 06:30:37.671509 30601 consensus_queue.cc:260] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.672328 30151 heartbeater.cc:503] Master 127.21.195.254:42521 was elected leader, sending a full tablet report...
I20260810 06:30:37.672628 30601 ts_tablet_manager.cc:1428] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 06:30:37.672533 30600 raft_consensus.cc:348] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.672792 30600 raft_consensus.cc:374] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:37.672842 30600 raft_consensus.cc:729] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4263697741844548a1730c83fa04f46, State: Initialized, Role: FOLLOWER
I20260810 06:30:37.673266 30600 consensus_queue.cc:260] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.674320 30600 ts_tablet_manager.cc:1428] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Time spent starting tablet: real 0.006s user 0.000s sys 0.007s
I20260810 06:30:37.674674 30571 heartbeater.cc:503] Master 127.21.195.254:42521 was elected leader, sending a full tablet report...
W20260810 06:30:37.724011 30152 tablet.cc:2369] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:37.857671 30572 tablet.cc:2369] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:37.914007 30366 tablet.cc:2369] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:30:37.943823 30611 raft_consensus.cc:482] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:37.944092 30611 raft_consensus.cc:504] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.945333 30611 leader_election.cc:288] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d54e1054eb174195b46531406e9cc8f9 (127.21.195.194:38733), 22089afe1d50434f9839abf27e51228b (127.21.195.193:45181)
I20260810 06:30:37.947764 30575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.945679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:45181 (local address 127.21.195.195:57529)
0810 06:30:37.945993 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:37.946011 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:37.946121 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:37.946540 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:37.946543 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:37.946557 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:37.947179 (+ 622us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:30:37.947181 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:37.947192 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:30:37.947225 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:37.947509 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:37.947513 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:37.947516 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 06:30:37.947591 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 06:30:37.947631 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216}
I20260810 06:30:37.947784 30597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.946156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:57529 (local address 127.21.195.193:45181)
0810 06:30:37.946306 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.946311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.946326 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:37.946373 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.946376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.946415 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.946504 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.947367 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.947371 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.947374 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.947388 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.947412 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.947421 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.947517 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.947633 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.947677 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:30:37.947875 30595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.945823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:40971 (local address 127.21.195.194:38733)
0810 06:30:37.946021 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:37.946026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:37.946226 (+ 200us) server_negotiation.cc:407] Connection header received
0810 06:30:37.946405 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:37.946408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:37.946444 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:37.946516 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:37.947429 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:37.947432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:37.947435 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:37.947446 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:37.947467 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:37.947477 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:37.947560 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:37.947694 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 06:30:37.947739 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260810 06:30:37.948192 30612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:37.945712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:38733 (local address 127.21.195.195:40971)
0810 06:30:37.946131 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:37.946146 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:37.946292 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:37.946607 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:37.946610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:37.946621 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:37.947252 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:30:37.947254 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:37.947262 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:30:37.947282 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:37.947578 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:37.947581 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:37.947585 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:30:37.948019 (+ 434us) client_negotiation.cc:240] Negotiation successful
0810 06:30:37.948058 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":128,"threads_started":1}
I20260810 06:30:37.948551 30068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bdd05e599db4576bed78279dc117fda" candidate_uuid: "c4263697741844548a1730c83fa04f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22089afe1d50434f9839abf27e51228b" is_pre_election: true
I20260810 06:30:37.948907 30288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bdd05e599db4576bed78279dc117fda" candidate_uuid: "c4263697741844548a1730c83fa04f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54e1054eb174195b46531406e9cc8f9" is_pre_election: true
I20260810 06:30:37.948954 30068 raft_consensus.cc:2454] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4263697741844548a1730c83fa04f46 in term 0.
I20260810 06:30:37.949208 30288 raft_consensus.cc:2454] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4263697741844548a1730c83fa04f46 in term 0.
I20260810 06:30:37.949599 30401 leader_election.cc:302] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22089afe1d50434f9839abf27e51228b, c4263697741844548a1730c83fa04f46; no voters:
I20260810 06:30:37.949928 30611 raft_consensus.cc:2781] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:37.950013 30611 raft_consensus.cc:482] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:37.950062 30611 raft_consensus.cc:3037] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:37.951155 30611 raft_consensus.cc:504] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.951537 30611 leader_election.cc:288] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [CANDIDATE]: Term 1 election: Requested vote from peers d54e1054eb174195b46531406e9cc8f9 (127.21.195.194:38733), 22089afe1d50434f9839abf27e51228b (127.21.195.193:45181)
I20260810 06:30:37.951922 30068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bdd05e599db4576bed78279dc117fda" candidate_uuid: "c4263697741844548a1730c83fa04f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22089afe1d50434f9839abf27e51228b"
I20260810 06:30:37.951932 30288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bdd05e599db4576bed78279dc117fda" candidate_uuid: "c4263697741844548a1730c83fa04f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d54e1054eb174195b46531406e9cc8f9"
I20260810 06:30:37.952056 30068 raft_consensus.cc:3037] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:37.952073 30288 raft_consensus.cc:3037] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:37.953233 30068 raft_consensus.cc:2454] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4263697741844548a1730c83fa04f46 in term 1.
I20260810 06:30:37.953418 30288 raft_consensus.cc:2454] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4263697741844548a1730c83fa04f46 in term 1.
I20260810 06:30:37.953568 30401 leader_election.cc:302] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22089afe1d50434f9839abf27e51228b, c4263697741844548a1730c83fa04f46; no voters:
I20260810 06:30:37.953799 30611 raft_consensus.cc:2781] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:37.954008 30611 raft_consensus.cc:686] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 1 LEADER]: Becoming Leader. State: Replica: c4263697741844548a1730c83fa04f46, State: Running, Role: LEADER
I20260810 06:30:37.954377 30611 consensus_queue.cc:237] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } }
I20260810 06:30:37.958376 29828 catalog_manager.cc:5495] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4263697741844548a1730c83fa04f46 (127.21.195.195). New cstate: current_term: 1 leader_uuid: "c4263697741844548a1730c83fa04f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4263697741844548a1730c83fa04f46" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 41493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 } health_report { overall_health: UNKNOWN } } }
I20260810 06:30:38.015039 30593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:38.013550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33746 (local address 127.21.195.195:41493)
0810 06:30:38.013687 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:38.013691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:38.013706 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:38.013816 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:38.013819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:38.013910 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:38.014000 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:38.014679 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:38.014683 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:38.014685 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:38.014697 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:38.014718 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:38.014728 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:38.014802 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:38.014852 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 06:30:38.014889 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:30:38.022107 30068 raft_consensus.cc:1261] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 1 FOLLOWER]: Refusing update from remote peer c4263697741844548a1730c83fa04f46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:38.022109 30288 raft_consensus.cc:1261] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 1 FOLLOWER]: Refusing update from remote peer c4263697741844548a1730c83fa04f46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:38.022969 30611 consensus_queue.cc:1035] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22089afe1d50434f9839abf27e51228b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 45181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:38.023190 30614 consensus_queue.cc:1035] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d54e1054eb174195b46531406e9cc8f9" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 38733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:38.045467 29828 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:38.045724 29828 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:38.048449 29828 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f716fb9fa48442d806b649bfc001aba: Sending DeleteTablet for 3 replicas of tablet 2bdd05e599db4576bed78279dc117fda
I20260810 06:30:38.049476 30259 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bdd05e599db4576bed78279dc117fda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:38 UTC) from {username='slave'} at 127.0.0.1:60272
I20260810 06:30:38.049757 30034 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bdd05e599db4576bed78279dc117fda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:38 UTC) from {username='slave'} at 127.0.0.1:52192
I20260810 06:30:38.050185 30635 tablet_replica.cc:330] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: stopping tablet replica
I20260810 06:30:38.050616 30636 tablet_replica.cc:330] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b: stopping tablet replica
I20260810 06:30:38.050557 30464 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bdd05e599db4576bed78279dc117fda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:38 UTC) from {username='slave'} at 127.0.0.1:33738
I20260810 06:30:38.050633 30635 raft_consensus.cc:2229] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:38.050944 30636 raft_consensus.cc:2229] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:38.051038 30635 raft_consensus.cc:2258] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:38.051193 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 29929
I20260810 06:30:38.051378 30636 raft_consensus.cc:2258] T 2bdd05e599db4576bed78279dc117fda P 22089afe1d50434f9839abf27e51228b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:38.055438 30635 ts_tablet_manager.cc:1905] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:38.083530 30637 tablet_replica.cc:330] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: stopping tablet replica
I20260810 06:30:38.083595 30635 ts_tablet_manager.cc:1918] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:38.083737 30635 log.cc:1196] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/2bdd05e599db4576bed78279dc117fda
I20260810 06:30:38.084152 30635 ts_tablet_manager.cc:1939] T 2bdd05e599db4576bed78279dc117fda P d54e1054eb174195b46531406e9cc8f9: Deleting consensus metadata
I20260810 06:30:38.084190 30637 raft_consensus.cc:2229] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:38.084919 30637 raft_consensus.cc:2258] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:38.086257 29810 catalog_manager.cc:4841] TS d54e1054eb174195b46531406e9cc8f9 (127.21.195.194:38733): tablet 2bdd05e599db4576bed78279dc117fda (table test-table [id=83d9fea6a85941e2a5dc6a781f14c7ef]) successfully deleted
I20260810 06:30:38.087004 30637 ts_tablet_manager.cc:1905] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:38.089501 30637 ts_tablet_manager.cc:1918] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:38.089673 30637 log.cc:1196] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/2bdd05e599db4576bed78279dc117fda
I20260810 06:30:38.089959 30637 ts_tablet_manager.cc:1939] T 2bdd05e599db4576bed78279dc117fda P c4263697741844548a1730c83fa04f46: Deleting consensus metadata
W20260810 06:30:38.090487 29807 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:45181 (error 108)
I20260810 06:30:38.091547 29807 catalog_manager.cc:4841] TS c4263697741844548a1730c83fa04f46 (127.21.195.195:41493): tablet 2bdd05e599db4576bed78279dc117fda (table test-table [id=83d9fea6a85941e2a5dc6a781f14c7ef]) successfully deleted
I20260810 06:30:38.091714 30592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:38.091380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:45181 (local address 127.0.0.1:52206)
0810 06:30:38.091542 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:38.091618 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:45181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 06:30:38.091859 29807 catalog_manager.cc:4584] TS 22089afe1d50434f9839abf27e51228b (127.21.195.193:45181): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2bdd05e599db4576bed78279dc117fda: Network error: Client connection negotiation failed: client connection to 127.21.195.193:45181: connect: Connection refused (error 111)
I20260810 06:30:38.092303 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 30161
I20260810 06:30:38.112741 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 30371
I20260810 06:30:38.132887 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 29783
2026-08-10T06:30:38Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1411 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 06:30:38.165165 22287 mini_oidc.cc:152] Starting JWKS server
I20260810 06:30:38.167260 22287 webserver.cc:460] Webserver started at https://127.0.0.1:33465/ using document root <none> and password file <none>
I20260810 06:30:38.167474 22287 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 06:30:38.167788 22287 webserver.cc:460] Webserver started at http://127.0.0.1:37875/ using document root <none> and password file <none>
2026-08-10T06:30:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:38Z Disabled control of system clock
I20260810 06:30:38.179119 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36175
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:43499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:36175
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33465/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/testchainca.cert with env {}
W20260810 06:30:38.303144 30645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:38.303516 30645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:38.303562 30645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:38.307894 30645 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:38.307986 30645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:38.307999 30645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:38.308015 30645 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:38.308030 30645 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 06:30:38.308044 30645 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 06:30:38.308058 30645 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33465/jwks.json
I20260810 06:30:38.314062 30645 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:36175
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33465/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:38.315389 30645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:38.316581 30645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:38.325874 30656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:38.325862 30657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:38.325862 30659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:38.326251 30645 server_base.cc:1034] running on GCE node
I20260810 06:30:38.326907 30645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:38.328188 30645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:38.329371 30645 hybrid_clock.cc:648] HybridClock initialized: now 1786343438329349 us; error 43 us; skew 500 ppm
I20260810 06:30:38.331516 30645 webserver.cc:460] Webserver started at http://127.21.195.254:35831/ using document root <none> and password file <none>
I20260810 06:30:38.332176 30645 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:38.332253 30645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:38.332499 30645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:38.334925 30645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "279d06af60e3487396785ee48ca96407"
format_stamp: "Formatted at 2026-08-10 06:30:38 on dist-test-slave-7lbf"
server_key: "22e527b4f28d3727dc384db50872c3a4"
server_key_iv: "bc1fb7d7890c36a637109f01aaf3758e"
server_key_version: "encryptionkey@0"
I20260810 06:30:38.335585 30645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "279d06af60e3487396785ee48ca96407"
format_stamp: "Formatted at 2026-08-10 06:30:38 on dist-test-slave-7lbf"
server_key: "22e527b4f28d3727dc384db50872c3a4"
server_key_iv: "bc1fb7d7890c36a637109f01aaf3758e"
server_key_version: "encryptionkey@0"
I20260810 06:30:38.339854 30645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:38.342692 30670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:38.344131 30645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:38.344281 30645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "279d06af60e3487396785ee48ca96407"
format_stamp: "Formatted at 2026-08-10 06:30:38 on dist-test-slave-7lbf"
server_key: "22e527b4f28d3727dc384db50872c3a4"
server_key_iv: "bc1fb7d7890c36a637109f01aaf3758e"
server_key_version: "encryptionkey@0"
I20260810 06:30:38.344412 30645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:38.358475 30645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:38.359359 30645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:38.359587 30645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:38.367384 30645 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:36175
I20260810 06:30:38.367398 30752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:36175 every 8 connection(s)
I20260810 06:30:38.368636 30645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:38.372457 30753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:38.376359 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 30645
I20260810 06:30:38.376506 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:38.376802 22287 external_mini_cluster.cc:1428] Setting key 08cf0d9ed8a71d0df612679f2258e98e
I20260810 06:30:38.379542 30753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407: Bootstrap starting.
I20260810 06:30:38.382230 30753 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:38.383111 30753 log.cc:824] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:38.385425 30753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407: No bootstrap required, opened a new log
I20260810 06:30:38.387225 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:38.378470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44646 (local address 127.21.195.254:36175)
0810 06:30:38.379258 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:38.379276 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:38.379326 (+ 50us) server_negotiation.cc:407] Connection header received
0810 06:30:38.380102 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:38.380127 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:38.380621 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:38.380989 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:38.381496 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.382623 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.383651 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.384178 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.384355 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:38.385237 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:38.385243 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:38.385259 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:38.385764 (+ 505us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:38.385833 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:38.385858 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:38.385958 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:38.386121 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 06:30:38.386429 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":168,"threads_started":1}
I20260810 06:30:38.389950 30753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "279d06af60e3487396785ee48ca96407" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36175 } }
I20260810 06:30:38.390288 30753 raft_consensus.cc:374] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:38.390347 30753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 279d06af60e3487396785ee48ca96407, State: Initialized, Role: FOLLOWER
I20260810 06:30:38.390895 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:30:38.390880 30753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "279d06af60e3487396785ee48ca96407" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36175 } }
I20260810 06:30:38.391039 30753 raft_consensus.cc:388] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:38.391106 30753 raft_consensus.cc:482] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:38.391212 30753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:38.392369 30753 raft_consensus.cc:504] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "279d06af60e3487396785ee48ca96407" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36175 } }
I20260810 06:30:38.392769 30753 leader_election.cc:302] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 279d06af60e3487396785ee48ca96407; no voters:
I20260810 06:30:38.393146 30753 leader_election.cc:288] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:38.393261 30758 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:38.393507 30758 raft_consensus.cc:686] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [term 1 LEADER]: Becoming Leader. State: Replica: 279d06af60e3487396785ee48ca96407, State: Running, Role: LEADER
I20260810 06:30:38.393913 30758 consensus_queue.cc:237] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "279d06af60e3487396785ee48ca96407" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36175 } }
I20260810 06:30:38.394484 30753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:38.395666 30760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "279d06af60e3487396785ee48ca96407" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "279d06af60e3487396785ee48ca96407" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36175 } } }
I20260810 06:30:38.395656 30762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 279d06af60e3487396785ee48ca96407. Latest consensus state: current_term: 1 leader_uuid: "279d06af60e3487396785ee48ca96407" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "279d06af60e3487396785ee48ca96407" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36175 } } }
I20260810 06:30:38.395815 30762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:38.395815 30760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:38.396283 30771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:38.399569 30771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:38.405987 30771 catalog_manager.cc:1347] Generated new cluster ID: 2258c254835d4633a95091ba7a2ff572
I20260810 06:30:38.406088 30771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:38.417418 30771 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:38.418493 30771 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:38.431690 30771 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 279d06af60e3487396785ee48ca96407: Generated new TSK 0
I20260810 06:30:38.432543 30771 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:30:38.466979 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:38.448680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44656 (local address 127.21.195.254:36175)
0810 06:30:38.448854 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:38.448859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:38.449162 (+ 303us) server_negotiation.cc:407] Connection header received
0810 06:30:38.449397 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:38.449399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:38.449469 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:38.449601 (+ 132us) server_negotiation.cc:226] Negotiated authn=JWT
0810 06:30:38.449923 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.450498 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.451764 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.452012 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.452086 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:38.452510 (+ 424us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 06:30:38.466541 (+ 14031us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33465/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 06:30:38.466838 (+ 297us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33465/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":72}
W20260810 06:30:38.467090 30756 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44656: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33465/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
E20260810 06:30:38.467572 30798 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 06:30:38.467763 30798 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260810 06:30:38.469029 30797 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:38.448544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:36175 (local address 127.0.0.1:44656)
0810 06:30:38.449031 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:38.449049 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:38.449216 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:38.449621 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:38.449624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:38.449634 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0810 06:30:38.449773 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:38.449780 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.450632 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.450635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:38.451647 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:38.451660 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.452123 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.452127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:38.452232 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:38.452305 (+ 73us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 06:30:38.466873 (+ 14568us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33465/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 06:30:38.467195 (+ 322us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.195.254:36175: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33465/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":149,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.21.195.254:36175: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33465/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 06:30:38.470003 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 30645
2026-08-10T06:30:38Z chronyd exiting
I20260810 06:30:38.533205 22287 test_util.cc:175] -----------------------------------------------
I20260810 06:30:38.533308 22287 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786343407647307-22287-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (370 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 06:30:38.534590 22287 mini_oidc.cc:152] Starting JWKS server
I20260810 06:30:38.535483 22287 webserver.cc:460] Webserver started at https://127.0.0.1:37073/ using document root <none> and password file <none>
I20260810 06:30:38.535573 22287 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 06:30:38.535797 22287 webserver.cc:460] Webserver started at http://127.0.0.1:43619/ using document root <none> and password file <none>
2026-08-10T06:30:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:38Z Disabled control of system clock
I20260810 06:30:38.546875 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:34299
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:44847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:34299
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37073/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/testchainca.cert with env {}
W20260810 06:30:38.670598 30811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:38.670957 30811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:38.671002 30811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:38.675313 30811 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:38.675400 30811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:38.675414 30811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:38.675431 30811 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:38.675444 30811 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 06:30:38.675459 30811 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 06:30:38.675472 30811 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37073/jwks.json
I20260810 06:30:38.681437 30811 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:34299
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:34299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37073/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:38.682746 30811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:38.683943 30811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:38.693625 30824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:38.693675 30828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:38.693744 30811 server_base.cc:1034] running on GCE node
W20260810 06:30:38.693645 30826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:38.694577 30811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:38.695854 30811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:38.697024 30811 hybrid_clock.cc:648] HybridClock initialized: now 1786343438697004 us; error 38 us; skew 500 ppm
I20260810 06:30:38.699095 30811 webserver.cc:460] Webserver started at http://127.21.195.254:43441/ using document root <none> and password file <none>
I20260810 06:30:38.699733 30811 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:38.699800 30811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:38.700016 30811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:38.702416 30811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "a8a5a36a7e8c43299b37572567fe619a"
format_stamp: "Formatted at 2026-08-10 06:30:38 on dist-test-slave-7lbf"
server_key: "6289da074920f4d9848b644e789b2c18"
server_key_iv: "c08825943227ebdad58e7f23ed7964e7"
server_key_version: "encryptionkey@0"
I20260810 06:30:38.703075 30811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "a8a5a36a7e8c43299b37572567fe619a"
format_stamp: "Formatted at 2026-08-10 06:30:38 on dist-test-slave-7lbf"
server_key: "6289da074920f4d9848b644e789b2c18"
server_key_iv: "c08825943227ebdad58e7f23ed7964e7"
server_key_version: "encryptionkey@0"
I20260810 06:30:38.707588 30811 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:38.710572 30837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:38.711962 30811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 06:30:38.712113 30811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "a8a5a36a7e8c43299b37572567fe619a"
format_stamp: "Formatted at 2026-08-10 06:30:38 on dist-test-slave-7lbf"
server_key: "6289da074920f4d9848b644e789b2c18"
server_key_iv: "c08825943227ebdad58e7f23ed7964e7"
server_key_version: "encryptionkey@0"
I20260810 06:30:38.712246 30811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:38.752481 30811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:38.753360 30811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:38.753620 30811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:38.761243 30811 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:34299
I20260810 06:30:38.761299 30916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:34299 every 8 connection(s)
I20260810 06:30:38.762420 30811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:38.764276 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 30811
I20260810 06:30:38.764396 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:38.764690 22287 external_mini_cluster.cc:1428] Setting key 48a3f02d630adef3aea14e6452b10632
I20260810 06:30:38.766404 30919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:38.773010 30919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a: Bootstrap starting.
I20260810 06:30:38.774982 30922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:38.766257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54986 (local address 127.21.195.254:34299)
0810 06:30:38.767012 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:38.767029 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:38.767070 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:30:38.767786 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:38.767805 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:38.768261 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:38.768625 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:38.769106 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.770198 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.771196 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.771717 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.771881 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:38.772939 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:38.772946 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:38.772961 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:38.773449 (+ 488us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:38.773553 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:38.773585 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:38.773678 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:38.773836 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 06:30:38.774133 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":165,"threads_started":1}
I20260810 06:30:38.775671 30919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:38.776640 30919 log.cc:824] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:38.778278 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:30:38.779253 30919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a: No bootstrap required, opened a new log
I20260810 06:30:38.783262 30919 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5a36a7e8c43299b37572567fe619a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34299 } }
I20260810 06:30:38.783572 30919 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:38.783640 30919 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8a5a36a7e8c43299b37572567fe619a, State: Initialized, Role: FOLLOWER
I20260810 06:30:38.784137 30919 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5a36a7e8c43299b37572567fe619a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34299 } }
I20260810 06:30:38.784282 30919 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:38.784353 30919 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:38.784474 30919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:38.785879 30919 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5a36a7e8c43299b37572567fe619a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34299 } }
I20260810 06:30:38.786341 30919 leader_election.cc:302] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8a5a36a7e8c43299b37572567fe619a; no voters:
I20260810 06:30:38.786741 30919 leader_election.cc:288] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:38.787210 30930 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:38.787497 30930 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [term 1 LEADER]: Becoming Leader. State: Replica: a8a5a36a7e8c43299b37572567fe619a, State: Running, Role: LEADER
I20260810 06:30:38.788348 30919 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:38.788548 30930 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5a36a7e8c43299b37572567fe619a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34299 } }
I20260810 06:30:38.790874 30934 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8a5a36a7e8c43299b37572567fe619a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5a36a7e8c43299b37572567fe619a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34299 } } }
I20260810 06:30:38.791039 30934 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:38.791347 30927 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8a5a36a7e8c43299b37572567fe619a. Latest consensus state: current_term: 1 leader_uuid: "a8a5a36a7e8c43299b37572567fe619a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8a5a36a7e8c43299b37572567fe619a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34299 } } }
I20260810 06:30:38.791456 30927 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a [sys.catalog]: This master's current role is: LEADER
W20260810 06:30:38.795331 30952 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:30:38.795475 30952 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:30:38.795555 30956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:38.796321 30956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:38.802850 30956 catalog_manager.cc:1347] Generated new cluster ID: bd90f8842ebc49c3a1f09d4195a40ef9
I20260810 06:30:38.802963 30956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:38.815151 30956 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:38.816601 30956 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:38.823706 30956 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8a5a36a7e8c43299b37572567fe619a: Generated new TSK 0
I20260810 06:30:38.824556 30956 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 06:30:38.860128 30972 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 06:30:38.860250 30972 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 06:30:38.861024 30922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:38.842096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54996 (local address 127.21.195.254:34299)
0810 06:30:38.842443 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:38.842448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:38.842507 (+ 59us) server_negotiation.cc:407] Connection header received
0810 06:30:38.842798 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:38.842802 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:38.842937 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:38.843072 (+ 135us) server_negotiation.cc:226] Negotiated authn=JWT
0810 06:30:38.843485 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.844131 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.845428 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.845745 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.845849 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:38.846183 (+ 334us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 06:30:38.860590 (+ 14407us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37073/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 06:30:38.860884 (+ 294us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54996: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37073/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":219}
W20260810 06:30:38.861104 30922 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54996: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37073/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 06:30:38.861285 30971 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:38.841880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34299 (local address 127.0.0.1:54996)
0810 06:30:38.842427 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:38.842444 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:38.842574 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:38.843147 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:38.843152 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:38.843164 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0810 06:30:38.843347 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:38.843356 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.844261 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.844265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:38.845269 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:38.845282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:38.845870 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:38.845874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:38.845971 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:38.846004 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 06:30:38.860850 (+ 14846us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37073/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 06:30:38.861084 (+ 234us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.195.254:34299: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37073/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":130,"threads_started":1}
I20260810 06:30:38.862006 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 30811
2026-08-10T06:30:38Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (381 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 06:30:38.916559 22287 mini_oidc.cc:152] Starting JWKS server
I20260810 06:30:38.917577 22287 webserver.cc:460] Webserver started at https://127.0.0.1:39123/ using document root <none> and password file <none>
I20260810 06:30:38.917704 22287 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 06:30:38.917976 22287 webserver.cc:460] Webserver started at http://127.0.0.1:45825/ using document root <none> and password file <none>
2026-08-10T06:30:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:38Z Disabled control of system clock
I20260810 06:30:38.929164 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:42483
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:41949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:42483
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39123/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 06:30:39.051270 30980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:39.051613 30980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:39.051656 30980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:39.056002 30980 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:39.056090 30980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:39.056106 30980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:39.056123 30980 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:39.056140 30980 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 06:30:39.056155 30980 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 06:30:39.056167 30980 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39123/jwks.json
I20260810 06:30:39.061429 30980 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:42483
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:42483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39123/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:39.062748 30980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:39.064327 30980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:39.073809 30987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:39.073814 30989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:39.073809 30991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:39.073992 30980 server_base.cc:1034] running on GCE node
I20260810 06:30:39.074853 30980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:39.076093 30980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:39.077308 30980 hybrid_clock.cc:648] HybridClock initialized: now 1786343439077284 us; error 38 us; skew 500 ppm
I20260810 06:30:39.079828 30980 webserver.cc:460] Webserver started at http://127.21.195.254:34307/ using document root <none> and password file <none>
I20260810 06:30:39.080502 30980 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:39.080586 30980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:39.080843 30980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:39.083287 30980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "76a6276bb7ef4c99a2ef3a48e8dab463"
format_stamp: "Formatted at 2026-08-10 06:30:39 on dist-test-slave-7lbf"
server_key: "38646e68de03ed5b2aa318859ba1e8f0"
server_key_iv: "5388a72ae886887bbd2bafee2b228cdf"
server_key_version: "encryptionkey@0"
I20260810 06:30:39.083957 30980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "76a6276bb7ef4c99a2ef3a48e8dab463"
format_stamp: "Formatted at 2026-08-10 06:30:39 on dist-test-slave-7lbf"
server_key: "38646e68de03ed5b2aa318859ba1e8f0"
server_key_iv: "5388a72ae886887bbd2bafee2b228cdf"
server_key_version: "encryptionkey@0"
I20260810 06:30:39.088285 30980 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 06:30:39.091180 31002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:39.092613 30980 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:39.092795 30980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "76a6276bb7ef4c99a2ef3a48e8dab463"
format_stamp: "Formatted at 2026-08-10 06:30:39 on dist-test-slave-7lbf"
server_key: "38646e68de03ed5b2aa318859ba1e8f0"
server_key_iv: "5388a72ae886887bbd2bafee2b228cdf"
server_key_version: "encryptionkey@0"
I20260810 06:30:39.092957 30980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:39.116863 30980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:39.117900 30980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:39.118136 30980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:39.125844 30980 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:42483
I20260810 06:30:39.125851 31082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:42483 every 8 connection(s)
I20260810 06:30:39.126963 30980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:39.130687 31083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:39.136785 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 30980
I20260810 06:30:39.136929 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:39.137235 22287 external_mini_cluster.cc:1428] Setting key 124e4442f429c771008932afb18bc2da
I20260810 06:30:39.137331 31083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463: Bootstrap starting.
I20260810 06:30:39.140364 31083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:39.141211 31083 log.cc:824] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:39.143321 31083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463: No bootstrap required, opened a new log
I20260810 06:30:39.147379 31087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:39.138883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42720 (local address 127.21.195.254:42483)
0810 06:30:39.139653 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:39.139669 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:39.139710 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:30:39.140421 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:39.140441 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:39.140939 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:39.141292 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:39.141797 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.142808 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.143809 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.144321 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.144478 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:39.145443 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:39.145449 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:39.145464 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:39.145934 (+ 470us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:39.145999 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:39.146022 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:39.146112 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:39.146271 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 06:30:39.146562 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":159,"threads_started":1}
I20260810 06:30:39.147346 31083 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76a6276bb7ef4c99a2ef3a48e8dab463" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42483 } }
I20260810 06:30:39.147635 31083 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:39.147686 31083 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76a6276bb7ef4c99a2ef3a48e8dab463, State: Initialized, Role: FOLLOWER
I20260810 06:30:39.148218 31083 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76a6276bb7ef4c99a2ef3a48e8dab463" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42483 } }
I20260810 06:30:39.148388 31083 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:39.148445 31083 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:39.148537 31083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:39.149601 31083 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76a6276bb7ef4c99a2ef3a48e8dab463" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42483 } }
I20260810 06:30:39.149998 31083 leader_election.cc:302] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76a6276bb7ef4c99a2ef3a48e8dab463; no voters:
I20260810 06:30:39.150377 31083 leader_election.cc:288] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:39.150887 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:30:39.150930 31093 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:39.151141 31093 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [term 1 LEADER]: Becoming Leader. State: Replica: 76a6276bb7ef4c99a2ef3a48e8dab463, State: Running, Role: LEADER
I20260810 06:30:39.151886 31083 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:39.151902 31093 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76a6276bb7ef4c99a2ef3a48e8dab463" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42483 } }
I20260810 06:30:39.153493 31094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76a6276bb7ef4c99a2ef3a48e8dab463. Latest consensus state: current_term: 1 leader_uuid: "76a6276bb7ef4c99a2ef3a48e8dab463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76a6276bb7ef4c99a2ef3a48e8dab463" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42483 } } }
I20260810 06:30:39.153668 31094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:39.154137 31111 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:39.154228 31089 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76a6276bb7ef4c99a2ef3a48e8dab463" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76a6276bb7ef4c99a2ef3a48e8dab463" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42483 } } }
I20260810 06:30:39.155082 31089 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:39.157459 31111 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:39.163867 31111 catalog_manager.cc:1347] Generated new cluster ID: 3433f08d36f64d959aa4b82cf84069be
I20260810 06:30:39.163964 31111 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:39.195641 31111 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:39.197209 31111 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:39.206929 31111 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76a6276bb7ef4c99a2ef3a48e8dab463: Generated new TSK 0
I20260810 06:30:39.208012 31111 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:30:39.227459 31087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:39.218325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42734 (local address 127.21.195.254:42483)
0810 06:30:39.218474 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:39.218480 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:39.218875 (+ 395us) server_negotiation.cc:407] Connection header received
0810 06:30:39.219113 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:39.219117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:39.219196 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:39.219346 (+ 150us) server_negotiation.cc:226] Negotiated authn=JWT
0810 06:30:39.219668 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.220526 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.224574 (+ 4048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.224934 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.225065 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:39.225473 (+ 408us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 06:30:39.227032 (+ 1559us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39123/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 06:30:39.227314 (+ 282us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42734: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39123/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 06:30:39.227550 31087 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42734: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39123/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 06:30:39.230239 31129 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:39.218183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:42483 (local address 127.0.0.1:42734)
0810 06:30:39.218758 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:39.218775 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:39.218928 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:39.219367 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:39.219371 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:39.219383 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0810 06:30:39.219525 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:39.219534 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.223320 (+ 3786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.223326 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:39.224393 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:39.224414 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.225102 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.225107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:39.225212 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:39.225246 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 06:30:39.227213 (+ 1967us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39123/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 06:30:39.230073 (+ 2860us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.195.254:42483: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39123/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":2605,"thread_start_us":122,"threads_started":1}
I20260810 06:30:39.230942 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 30980
E20260810 06:30:39.243283 31130 webserver.cc:533] Webserver: sslize failed:
E20260810 06:30:39.243386 31130 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T06:30:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (384 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T06:30:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:39Z Disabled control of system clock
I20260810 06:30:39.311831 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36089
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:45375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:36089
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/testchainca.cert with env {}
W20260810 06:30:39.434515 31136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:39.434870 31136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:39.434917 31136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:39.439265 31136 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:39.439361 31136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:39.439379 31136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:39.439399 31136 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:39.439417 31136 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 06:30:39.439442 31136 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 06:30:39.439476 31136 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 06:30:39.445485 31136 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:45375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:36089
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:39.446862 31136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:39.448038 31136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:30:39.457868 31136 server_base.cc:1034] running on GCE node
W20260810 06:30:39.457810 31144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:39.457921 31143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:39.457810 31151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:39.458719 31136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:39.459934 31136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:39.461112 31136 hybrid_clock.cc:648] HybridClock initialized: now 1786343439461092 us; error 40 us; skew 500 ppm
I20260810 06:30:39.463240 31136 webserver.cc:460] Webserver started at http://127.21.195.254:42067/ using document root <none> and password file <none>
I20260810 06:30:39.463891 31136 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:39.463964 31136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:39.464191 31136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:39.466560 31136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "6e11cddceaa04a9ab1aa118c75bf20dc"
format_stamp: "Formatted at 2026-08-10 06:30:39 on dist-test-slave-7lbf"
server_key: "1bb13b727e109bf727acf6eaeea93091"
server_key_iv: "6242e47a777a7326d5a614e4874a9edc"
server_key_version: "encryptionkey@0"
I20260810 06:30:39.467193 31136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "6e11cddceaa04a9ab1aa118c75bf20dc"
format_stamp: "Formatted at 2026-08-10 06:30:39 on dist-test-slave-7lbf"
server_key: "1bb13b727e109bf727acf6eaeea93091"
server_key_iv: "6242e47a777a7326d5a614e4874a9edc"
server_key_version: "encryptionkey@0"
I20260810 06:30:39.471597 31136 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260810 06:30:39.474452 31160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:39.475857 31136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:39.476011 31136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "6e11cddceaa04a9ab1aa118c75bf20dc"
format_stamp: "Formatted at 2026-08-10 06:30:39 on dist-test-slave-7lbf"
server_key: "1bb13b727e109bf727acf6eaeea93091"
server_key_iv: "6242e47a777a7326d5a614e4874a9edc"
server_key_version: "encryptionkey@0"
I20260810 06:30:39.476138 31136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:39.499286 31136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:39.500141 31136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:39.500347 31136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:39.507655 31136 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:36089
I20260810 06:30:39.507668 31231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:36089 every 8 connection(s)
I20260810 06:30:39.508761 31136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:39.512033 31233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:39.518445 31233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc: Bootstrap starting.
I20260810 06:30:39.519039 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 31136
I20260810 06:30:39.519150 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:39.519407 22287 external_mini_cluster.cc:1428] Setting key 319b1158543ab1dd0d86dcc0c4831abb
I20260810 06:30:39.521438 31233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:39.522291 31233 log.cc:824] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:39.524602 31233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc: No bootstrap required, opened a new log
I20260810 06:30:39.529119 31233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e11cddceaa04a9ab1aa118c75bf20dc" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36089 } }
I20260810 06:30:39.529395 31233 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:39.529470 31233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e11cddceaa04a9ab1aa118c75bf20dc, State: Initialized, Role: FOLLOWER
I20260810 06:30:39.529579 31236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:39.520895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49370 (local address 127.21.195.254:36089)
0810 06:30:39.521658 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:39.521674 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:39.521714 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:30:39.522409 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:39.522431 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:39.522903 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:39.523237 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:39.523616 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.524692 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.525992 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.526518 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.526647 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:39.527544 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:39.527550 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:39.527567 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:30:39.528012 (+ 445us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:39.528078 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:30:39.528100 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:39.528176 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:39.528346 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 06:30:39.528649 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":127,"threads_started":1}
I20260810 06:30:39.530032 31233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e11cddceaa04a9ab1aa118c75bf20dc" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36089 } }
I20260810 06:30:39.530184 31233 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:39.530253 31233 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:39.530360 31233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:39.531411 31233 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e11cddceaa04a9ab1aa118c75bf20dc" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36089 } }
I20260810 06:30:39.531821 31233 leader_election.cc:302] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e11cddceaa04a9ab1aa118c75bf20dc; no voters:
I20260810 06:30:39.532186 31233 leader_election.cc:288] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:39.532301 31241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:39.532547 31241 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [term 1 LEADER]: Becoming Leader. State: Replica: 6e11cddceaa04a9ab1aa118c75bf20dc, State: Running, Role: LEADER
I20260810 06:30:39.532868 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:30:39.532966 31241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e11cddceaa04a9ab1aa118c75bf20dc" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36089 } }
I20260810 06:30:39.533645 31233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:39.534838 31242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e11cddceaa04a9ab1aa118c75bf20dc. Latest consensus state: current_term: 1 leader_uuid: "6e11cddceaa04a9ab1aa118c75bf20dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e11cddceaa04a9ab1aa118c75bf20dc" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36089 } } }
I20260810 06:30:39.534896 31243 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e11cddceaa04a9ab1aa118c75bf20dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e11cddceaa04a9ab1aa118c75bf20dc" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36089 } } }
I20260810 06:30:39.534977 31242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:39.535013 31243 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:39.535332 31253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:39.538900 31253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:39.551368 31253 catalog_manager.cc:1347] Generated new cluster ID: b3831840e8b048418310dec23a6b4dd9
I20260810 06:30:39.551497 31253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:39.579305 31253 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:39.580732 31253 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:39.589571 31253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e11cddceaa04a9ab1aa118c75bf20dc: Generated new TSK 0
I20260810 06:30:39.590413 31253 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:30:39.628242 31236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:39.609805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49384 (local address 127.21.195.254:36089)
0810 06:30:39.609954 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:39.609960 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:39.610144 (+ 184us) server_negotiation.cc:407] Connection header received
0810 06:30:39.610323 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:39.610326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:39.610394 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:39.610560 (+ 166us) server_negotiation.cc:226] Negotiated authn=JWT
0810 06:30:39.610764 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.611603 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.612534 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.612900 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.613008 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:39.613340 (+ 332us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 06:30:39.627718 (+ 14378us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 06:30:39.628081 (+ 363us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49384: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 06:30:39.628362 31236 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49384: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 06:30:39.628371 31281 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:39.609692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:36089 (local address 127.0.0.1:49384)
0810 06:30:39.610052 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:39.610066 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:39.610183 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:39.610542 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:39.610544 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:39.610551 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0810 06:30:39.610661 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:39.610666 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.611747 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.611749 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:39.612414 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:39.612424 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:39.613041 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:39.613044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:39.613118 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:39.613145 (+ 27us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 06:30:39.628004 (+ 14859us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 06:30:39.628201 (+ 197us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.195.254:36089: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":136,"threads_started":1}
I20260810 06:30:39.629418 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 31136
2026-08-10T06:30:39Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (359 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (149 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (142 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:39 dist-test-slave-7lbf krb5kdc[31301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:39 dist-test-slave-7lbf krb5kdc[31301](info): set up 2 sockets
Aug 10 06:30:39 dist-test-slave-7lbf krb5kdc[31301](info): commencing operation
krb5kdc: starting...
W20260810 06:30:41.110756 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:41 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:41.246665 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:41037
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:41037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:41.369227 31320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:41.369613 31320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:41.369685 31320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:41.373989 31320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:41.374068 31320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:41.374094 31320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:41.374114 31320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:41.374135 31320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:41.379987 31320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:41037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:41037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:41.381290 31320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:41.382597 31320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:41.392381 31329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:41.392402 31326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:41.392400 31331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:41.392783 31320 server_base.cc:1034] running on GCE node
I20260810 06:30:41.393450 31320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:41.394784 31320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:41.395972 31320 hybrid_clock.cc:648] HybridClock initialized: now 1786343441395935 us; error 54 us; skew 500 ppm
Aug 10 06:30:41 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343441, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:41.401947 31320 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:41.403149 31320 webserver.cc:460] Webserver started at http://127.21.195.254:34465/ using document root <none> and password file <none>
I20260810 06:30:41.403811 31320 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:41.403895 31320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:41.404129 31320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:41.406574 31320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "523944b076764694b8df8f8b648ed806"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "822a777a94567e51f8097e84f0a3cd0e"
server_key_iv: "4c4add0d9da03495b188e370fd57418c"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.407217 31320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "523944b076764694b8df8f8b648ed806"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "822a777a94567e51f8097e84f0a3cd0e"
server_key_iv: "4c4add0d9da03495b188e370fd57418c"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.411640 31320 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:41.414548 31345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:41.416059 31320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:41.416219 31320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "523944b076764694b8df8f8b648ed806"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "822a777a94567e51f8097e84f0a3cd0e"
server_key_iv: "4c4add0d9da03495b188e370fd57418c"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.416343 31320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:41.431461 31320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:41.435174 31320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:41.435387 31320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:41.442984 31320 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:41037
I20260810 06:30:41.443011 31430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:41037 every 8 connection(s)
I20260810 06:30:41.444159 31320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:41.444646 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 31320
I20260810 06:30:41.444769 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:41.445070 22287 external_mini_cluster.cc:1428] Setting key a8005d50be7c547bd22354aeda89e724
I20260810 06:30:41.447692 31431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 06:30:41 dist-test-slave-7lbf krb5kdc[31301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:41.455236 31431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806: Bootstrap starting.
I20260810 06:30:41.457983 31431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:41.458949 31431 log.cc:824] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:41.460742 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:41.446712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33406 (local address 127.21.195.254:41037)
0810 06:30:41.447158 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:41.447176 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:41.447218 (+ 42us) server_negotiation.cc:407] Connection header received
0810 06:30:41.447936 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:41.447957 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:41.448342 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:41.448664 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:41.449661 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:41.450737 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:41.451961 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:41.452475 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:41.452599 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:41.455701 (+ 3102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:41.455707 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:41.455724 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:41.455760 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:41.457560 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:41.458104 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:41.458111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:41.458118 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:41.458253 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:41.458556 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:41.458559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:41.458560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:41.459016 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:41.459206 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:41.459549 (+ 343us) server_negotiation.cc:299] Negotiation successful
0810 06:30:41.459904 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":121,"threads_started":1}
I20260810 06:30:41.461319 31431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806: No bootstrap required, opened a new log
I20260810 06:30:41.465783 31431 raft_consensus.cc:348] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523944b076764694b8df8f8b648ed806" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41037 } }
I20260810 06:30:41.466068 31431 raft_consensus.cc:374] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:41.466138 31431 raft_consensus.cc:729] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523944b076764694b8df8f8b648ed806, State: Initialized, Role: FOLLOWER
I20260810 06:30:41.466620 31431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523944b076764694b8df8f8b648ed806" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41037 } }
I20260810 06:30:41.466768 31431 raft_consensus.cc:388] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:41.466835 31431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:41.466940 31431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:41.468225 31431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523944b076764694b8df8f8b648ed806" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41037 } }
I20260810 06:30:41.468657 31431 leader_election.cc:302] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 523944b076764694b8df8f8b648ed806; no voters:
I20260810 06:30:41.469048 31431 leader_election.cc:288] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:41.469159 31444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:41.469377 31444 raft_consensus.cc:686] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [term 1 LEADER]: Becoming Leader. State: Replica: 523944b076764694b8df8f8b648ed806, State: Running, Role: LEADER
I20260810 06:30:41.469802 31444 consensus_queue.cc:237] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523944b076764694b8df8f8b648ed806" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41037 } }
I20260810 06:30:41.470440 31431 sys_catalog.cc:564] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:41.471680 31446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "523944b076764694b8df8f8b648ed806" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523944b076764694b8df8f8b648ed806" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41037 } } }
I20260810 06:30:41.471678 31447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 523944b076764694b8df8f8b648ed806. Latest consensus state: current_term: 1 leader_uuid: "523944b076764694b8df8f8b648ed806" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523944b076764694b8df8f8b648ed806" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41037 } } }
I20260810 06:30:41.471832 31446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:41.471832 31447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:41.472302 31457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:41.475593 31457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:41.481964 31457 catalog_manager.cc:1347] Generated new cluster ID: e0c27b4f1d6b474bbe364254c33b6200
I20260810 06:30:41.482074 31457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:41.497058 31457 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:41.498209 31457 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:41.503918 31457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 523944b076764694b8df8f8b648ed806: Generated new TSK 0
I20260810 06:30:41.504739 31457 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:41.546591 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41037
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:41.698869 31485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:41.699186 31485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:41.699232 31485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:41.703576 31485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:41.703668 31485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:41.703737 31485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:41.709493 31485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:41.710850 31485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:41.712049 31485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:41.722808 31498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:41.722810 31495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:41.722865 31485 server_base.cc:1034] running on GCE node
W20260810 06:30:41.722811 31493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:41.723591 31485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:41.724320 31485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:41.725598 31485 hybrid_clock.cc:648] HybridClock initialized: now 1786343441725572 us; error 41 us; skew 500 ppm
Aug 10 06:30:41 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343441, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:41.728618 31485 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:41.729751 31485 webserver.cc:460] Webserver started at http://127.21.195.193:33093/ using document root <none> and password file <none>
I20260810 06:30:41.730373 31485 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:41.730460 31485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:41.730726 31485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:41.733078 31485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "131a0384aabc4cdbb8f50a8975ddfed2"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "3db4d1e8802d95841d3e747303dabab8"
server_key_iv: "00796e93f24d5ad95ffafae6a54da64a"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.733759 31485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "131a0384aabc4cdbb8f50a8975ddfed2"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "3db4d1e8802d95841d3e747303dabab8"
server_key_iv: "00796e93f24d5ad95ffafae6a54da64a"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.738647 31485 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260810 06:30:41.741408 31507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:41.742812 31485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:41.742955 31485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "131a0384aabc4cdbb8f50a8975ddfed2"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "3db4d1e8802d95841d3e747303dabab8"
server_key_iv: "00796e93f24d5ad95ffafae6a54da64a"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.743072 31485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:41.766882 31485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:41.770476 31485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:41.770709 31485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:41.771539 31485 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:41.772571 31485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:41.772626 31485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:41.772687 31485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:41.772715 31485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:41.782024 31485 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:41545
I20260810 06:30:41.782052 31689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:41545 every 8 connection(s)
I20260810 06:30:41.783071 31485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:41.786221 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 31485
I20260810 06:30:41.786374 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:41.786715 22287 external_mini_cluster.cc:1428] Setting key 179efbc2aa07bfae37145e5929f09092
Aug 10 06:30:41 dist-test-slave-7lbf krb5kdc[31301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343441, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:41.799057 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:41.785106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:55361 (local address 127.21.195.254:41037)
0810 06:30:41.785286 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:41.785299 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:41.786348 (+ 1049us) server_negotiation.cc:407] Connection header received
0810 06:30:41.788006 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:41.788009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:41.788065 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:41.788140 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:41.789560 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:41.790312 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:41.792047 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:41.792375 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:41.792484 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:41.795296 (+ 2812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:41.795301 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:41.795303 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:41.795333 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:41.796726 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:41.797269 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:41.797273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:41.797274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:41.797364 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:41.797756 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:41.797760 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:41.797762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:41.798008 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:41.798103 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:41.798701 (+ 598us) server_negotiation.cc:299] Negotiation successful
0810 06:30:41.798871 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 06:30:41.799970 31692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:41.785626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41037 (local address 127.21.195.193:55361)
0810 06:30:41.786177 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:41.786229 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:41.787750 (+ 1521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:41.788361 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:41.788373 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:41.788826 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:41.789370 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:41.789385 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:41.790465 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:41.790469 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:41.791887 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:41.791901 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:41.792526 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:41.792528 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:41.792691 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:41.793315 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:41.793334 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:41.795098 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:41.796851 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:41.796858 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:41.796878 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:41.797164 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:41.797453 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:41.797456 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:41.797458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:41.797663 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:41.798113 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:41.798121 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:41.798434 (+ 313us) client_negotiation.cc:769] Sending connection context
0810 06:30:41.798618 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 06:30:41.798999 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":133,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:41.801424 31690 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41037
I20260810 06:30:41.801738 31690 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:41.802336 31690 heartbeater.cc:511] Master 127.21.195.254:41037 requested a full tablet report, sending...
I20260810 06:30:41.804203 31371 ts_manager.cc:194] Registered new tserver with Master: 131a0384aabc4cdbb8f50a8975ddfed2 (127.21.195.193:41545)
I20260810 06:30:41.805410 31371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:55361
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:41.818293 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41037
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:41.943158 31701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:41.943507 31701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:41.943557 31701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:41.947901 31701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:41.947983 31701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:41.948048 31701 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:41.953817 31701 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:41.955086 31701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:41.956300 31701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:30:41.967031 31701 server_base.cc:1034] running on GCE node
W20260810 06:30:41.966967 31708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:41.966987 31714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:41.966960 31709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:41.967710 31701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:41.968442 31701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:41.969589 31701 hybrid_clock.cc:648] HybridClock initialized: now 1786343441969562 us; error 40 us; skew 500 ppm
Aug 10 06:30:41 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343441, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:41.972687 31701 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:41.973775 31701 webserver.cc:460] Webserver started at http://127.21.195.194:37451/ using document root <none> and password file <none>
I20260810 06:30:41.974391 31701 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:41.974466 31701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:41.974699 31701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:41.977141 31701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "f8755f277fa04ea3b6b72f3e8da5b5c1"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "69d18527c633022362f3bf064d92663c"
server_key_iv: "bb754b227389ae526b8355d3925ece25"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.977794 31701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "f8755f277fa04ea3b6b72f3e8da5b5c1"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "69d18527c633022362f3bf064d92663c"
server_key_iv: "bb754b227389ae526b8355d3925ece25"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.982030 31701 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:30:41.984779 31722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:41.986229 31701 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:41.986366 31701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "f8755f277fa04ea3b6b72f3e8da5b5c1"
format_stamp: "Formatted at 2026-08-10 06:30:41 on dist-test-slave-7lbf"
server_key: "69d18527c633022362f3bf064d92663c"
server_key_iv: "bb754b227389ae526b8355d3925ece25"
server_key_version: "encryptionkey@0"
I20260810 06:30:41.986496 31701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:42.005097 31701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:42.008518 31701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:42.008736 31701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:42.009435 31701 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:42.010452 31701 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:42.010529 31701 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:42.010592 31701 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:42.010617 31701 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:42.019838 31701 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:39307
I20260810 06:30:42.019903 31894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:39307 every 8 connection(s)
I20260810 06:30:42.021004 31701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:42.026571 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 31701
I20260810 06:30:42.026676 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:42.026924 22287 external_mini_cluster.cc:1428] Setting key 43fbaf0dec19280948d9952c67b84c16
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343441, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:42.036701 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:42.023053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:44339 (local address 127.21.195.254:41037)
0810 06:30:42.023202 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:42.023206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:42.024205 (+ 999us) server_negotiation.cc:407] Connection header received
0810 06:30:42.025664 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:42.025668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:42.025732 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:42.025813 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:42.027199 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.027789 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.029370 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.029657 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.029748 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:42.032530 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:42.032535 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:42.032537 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:42.032571 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:42.034305 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.034870 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.034874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.034876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.034991 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.035349 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.035353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.035355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.035639 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:42.035770 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:42.036344 (+ 574us) server_negotiation.cc:299] Negotiation successful
0810 06:30:42.036517 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:30:42.037658 31903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:42.023500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41037 (local address 127.21.195.194:44339)
0810 06:30:42.024046 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:42.024099 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:42.025397 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:42.026029 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:42.026037 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:42.026446 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:42.027046 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:42.027064 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.027930 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.027934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:42.029237 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:42.029252 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.029816 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.029820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:42.030042 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:42.030743 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:42.030761 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:42.032326 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:42.034435 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:42.034443 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:42.034462 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:42.034761 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:42.035084 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:42.035086 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:42.035087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:42.035248 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:42.035760 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:42.035766 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:42.036072 (+ 306us) client_negotiation.cc:769] Sending connection context
0810 06:30:42.036256 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 06:30:42.036563 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:30:42.039011 31895 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41037
I20260810 06:30:42.039292 31895 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:42.039860 31895 heartbeater.cc:511] Master 127.21.195.254:41037 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:30:42.041178 31371 ts_manager.cc:194] Registered new tserver with Master: f8755f277fa04ea3b6b72f3e8da5b5c1 (127.21.195.194:39307)
I20260810 06:30:42.041838 31371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:44339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:42.056718 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41037
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:43641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:42.180537 31910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:42.180868 31910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:42.180936 31910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:42.185232 31910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:42.185320 31910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:42.185407 31910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:42.191532 31910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:42.192793 31910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:42.193992 31910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:42.205003 31919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:42.204998 31918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:42.205073 31910 server_base.cc:1034] running on GCE node
W20260810 06:30:42.205013 31924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:42.205818 31910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:42.206554 31910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:42.207721 31910 hybrid_clock.cc:648] HybridClock initialized: now 1786343442207697 us; error 40 us; skew 500 ppm
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:42.210785 31910 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:42.211840 31910 webserver.cc:460] Webserver started at http://127.21.195.195:43539/ using document root <none> and password file <none>
I20260810 06:30:42.212479 31910 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:42.212564 31910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:42.212805 31910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:42.215216 31910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "110c8531940f47df8771f7127df53a7a"
format_stamp: "Formatted at 2026-08-10 06:30:42 on dist-test-slave-7lbf"
server_key: "e0257342bf9afa023a30cd599a511ab2"
server_key_iv: "470a11fd2c82ee5a6ad903d2915d49ea"
server_key_version: "encryptionkey@0"
I20260810 06:30:42.215852 31910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "110c8531940f47df8771f7127df53a7a"
format_stamp: "Formatted at 2026-08-10 06:30:42 on dist-test-slave-7lbf"
server_key: "e0257342bf9afa023a30cd599a511ab2"
server_key_iv: "470a11fd2c82ee5a6ad903d2915d49ea"
server_key_version: "encryptionkey@0"
I20260810 06:30:42.220338 31910 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:30:42.223398 31931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:42.224959 31910 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:42.225109 31910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "110c8531940f47df8771f7127df53a7a"
format_stamp: "Formatted at 2026-08-10 06:30:42 on dist-test-slave-7lbf"
server_key: "e0257342bf9afa023a30cd599a511ab2"
server_key_iv: "470a11fd2c82ee5a6ad903d2915d49ea"
server_key_version: "encryptionkey@0"
I20260810 06:30:42.225235 31910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:42.256352 31910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:42.259610 31910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:42.259829 31910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:42.260520 31910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:42.261547 31910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:42.261608 31910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:42.261668 31910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:42.261693 31910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:42.271081 31910 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:37763
I20260810 06:30:42.271129 32114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:37763 every 8 connection(s)
I20260810 06:30:42.272233 31910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:42.274775 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 31910
I20260810 06:30:42.274899 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:42.275249 22287 external_mini_cluster.cc:1428] Setting key ca0f596895b0d028101ae773b07b3098
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:42.286715 31442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:42.274252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:60485 (local address 127.21.195.254:41037)
0810 06:30:42.274387 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:42.274390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:42.275491 (+ 1101us) server_negotiation.cc:407] Connection header received
0810 06:30:42.277257 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:42.277261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:42.277318 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:42.277410 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:42.278819 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.279357 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.280511 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.280724 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.280793 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:42.283404 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:42.283407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:42.283409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:42.283435 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:42.284720 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.285235 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.285237 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.285238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.285316 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.285649 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.285652 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.285653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.285856 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:42.285934 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:42.286452 (+ 518us) server_negotiation.cc:299] Negotiation successful
0810 06:30:42.286575 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:30:42.287693 32119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:42.274696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41037 (local address 127.21.195.195:60485)
0810 06:30:42.275281 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:42.275352 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:42.277024 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:42.277659 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:42.277671 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:42.278130 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:42.278678 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:42.278693 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.279462 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.279465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:42.280408 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:42.280418 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.280842 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.280845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:42.281013 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:42.281659 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:42.281677 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:42.283228 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:42.284831 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:42.284837 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:42.284853 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:42.285153 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:42.285380 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:42.285382 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:42.285384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:42.285574 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:42.285935 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:42.285941 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:42.286234 (+ 293us) client_negotiation.cc:769] Sending connection context
0810 06:30:42.286402 (+ 168us) client_negotiation.cc:240] Negotiation successful
0810 06:30:42.286701 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":132,"threads_started":1}
I20260810 06:30:42.289193 32115 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41037
I20260810 06:30:42.289506 32115 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:42.290241 32115 heartbeater.cc:511] Master 127.21.195.254:41037 requested a full tablet report, sending...
I20260810 06:30:42.291363 31370 ts_manager.cc:194] Registered new tserver with Master: 110c8531940f47df8771f7127df53a7a (127.21.195.195:37763)
I20260810 06:30:42.291971 31370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:60485
I20260810 06:30:42.301944 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/test-admin.keytab.
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:42.320107 22287 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 06:30:42.326009 32129 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:42.323924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45600 (local address 127.21.195.193:41545)
0810 06:30:42.324434 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:42.324441 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:42.324464 (+ 23us) server_negotiation.cc:407] Connection header received
0810 06:30:42.324523 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:42.324530 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:42.324793 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:42.324947 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:42.325818 (+ 871us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45600: BlockingRecv error: recv got EOF from 127.0.0.1:45600 (error 108)
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":97,"threads_started":1}
W20260810 06:30:42.326026 22287 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5cc' of type FILE
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:42.327196 22287 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:42.328286 22287 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:42.348086 32129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:42.329566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45602 (local address 127.21.195.193:41545)
0810 06:30:42.329707 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:42.329712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:42.333843 (+ 4131us) server_negotiation.cc:407] Connection header received
0810 06:30:42.334003 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:42.334007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:42.334071 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:42.334157 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:42.335046 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.336245 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.337284 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.337795 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.337918 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:42.343256 (+ 5338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:42.343276 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:42.343302 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:42.343339 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:42.345667 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.346222 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.346231 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.346232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.346396 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.346748 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.346751 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.346753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.347141 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:42.347442 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:42.347712 (+ 270us) server_negotiation.cc:299] Negotiation successful
0810 06:30:42.347918 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 06:30:42.353158 32129 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:42.351985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45612 (local address 127.21.195.193:41545)
0810 06:30:42.352095 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:42.352099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:42.352244 (+ 145us) server_negotiation.cc:407] Connection header received
0810 06:30:42.352379 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:42.352382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:42.352429 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:42.352496 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:42.352959 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45612: BlockingRecv error: recv got EOF from 127.0.0.1:45612 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 06:30:42.353470 22287 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5cc)
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:42.354899 22287 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:42.355896 22287 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:42.365214 32129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:42.356829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45620 (local address 127.21.195.193:41545)
0810 06:30:42.356979 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:42.356983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:42.357203 (+ 220us) server_negotiation.cc:407] Connection header received
0810 06:30:42.357335 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:42.357339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:42.357394 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:42.357462 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:42.358040 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.358566 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.359386 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.359623 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.359715 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:42.362135 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:42.362138 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:42.362140 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:42.362168 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:42.363552 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.364079 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.364081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.364083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.364161 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.364422 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.364424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.364425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.364596 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:42.364714 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:42.364961 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 06:30:42.365073 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260810 06:30:42.367937 32129 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:42.367069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45622 (local address 127.21.195.193:41545)
0810 06:30:42.367217 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:42.367222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:42.367269 (+ 47us) server_negotiation.cc:407] Connection header received
0810 06:30:42.367374 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:42.367377 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:42.367419 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:42.367482 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:42.367823 (+ 341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45622: BlockingRecv error: recv got EOF from 127.0.0.1:45622 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 06:30:42.368096 22287 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786343407647307-22287-0/krb5kdc/krb5cc' of type FILE
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:42.369174 22287 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:42.370069 22287 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[31301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:30:42.378515 32129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:42.370972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45626 (local address 127.21.195.193:41545)
0810 06:30:42.371104 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:42.371108 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:42.371177 (+ 69us) server_negotiation.cc:407] Connection header received
0810 06:30:42.371293 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:42.371295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:42.371336 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:42.371413 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:42.371883 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.372461 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.373258 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:42.373467 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:42.373564 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:42.375700 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:42.375704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:42.375706 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:42.375730 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:42.376898 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.377300 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.377304 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.377305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.377387 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:42.377679 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:42.377682 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:42.377684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:42.377872 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:42.378009 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:42.378238 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 06:30:42.378355 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:30:42.379601 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 31485
I20260810 06:30:42.406033 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 31701
I20260810 06:30:42.425179 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 31910
I20260810 06:30:42.436847 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 31320
2026-08-10T06:30:42Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2516 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[32156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[32156](info): set up 2 sockets
Aug 10 06:30:42 dist-test-slave-7lbf krb5kdc[32156](info): commencing operation
krb5kdc: starting...
W20260810 06:30:43.620071 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:43 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:43Z Disabled control of system clock
WARNING: no policy specified for oryx/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.254.keytab.
Entry for principal oryx/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.254.keytab.
I20260810 06:30:43.753043 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44679
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.254.keytab
--principal=oryx/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:44679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:43.879551 32172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:43.879904 32172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:43.879967 32172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:43.884343 32172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:43.884451 32172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:43.884479 32172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:43.884501 32172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:43.884523 32172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:43.890447 32172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:44679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.254.keytab
--principal=oryx/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:43.891743 32172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:43.892988 32172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:43.902346 32191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:43.902338 32187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:43.902338 32186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:43.902846 32172 server_base.cc:1034] running on GCE node
I20260810 06:30:43.903544 32172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:43.904844 32172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:43.906018 32172 hybrid_clock.cc:648] HybridClock initialized: now 1786343443905999 us; error 32 us; skew 500 ppm
Aug 10 06:30:43 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343443, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:43.909066 32172 init.cc:377] Logged in from keytab as oryx/127.21.195.254@KRBTEST.COM (short username oryx)
I20260810 06:30:43.910213 32172 webserver.cc:460] Webserver started at http://127.21.195.254:36103/ using document root <none> and password file <none>
I20260810 06:30:43.910845 32172 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:43.910920 32172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:43.911149 32172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:43.913429 32172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "b11382a7a35f4ccfbd1cd73ef150e1df"
format_stamp: "Formatted at 2026-08-10 06:30:43 on dist-test-slave-7lbf"
server_key: "151e0eb8412b01168445b8ec9f357228"
server_key_iv: "cf662ecb9f025f85c968d4b3a6399049"
server_key_version: "encryptionkey@0"
I20260810 06:30:43.914109 32172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "b11382a7a35f4ccfbd1cd73ef150e1df"
format_stamp: "Formatted at 2026-08-10 06:30:43 on dist-test-slave-7lbf"
server_key: "151e0eb8412b01168445b8ec9f357228"
server_key_iv: "cf662ecb9f025f85c968d4b3a6399049"
server_key_version: "encryptionkey@0"
I20260810 06:30:43.918387 32172 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:43.921202 32206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:43.922645 32172 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:43.922789 32172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "b11382a7a35f4ccfbd1cd73ef150e1df"
format_stamp: "Formatted at 2026-08-10 06:30:43 on dist-test-slave-7lbf"
server_key: "151e0eb8412b01168445b8ec9f357228"
server_key_iv: "cf662ecb9f025f85c968d4b3a6399049"
server_key_version: "encryptionkey@0"
I20260810 06:30:43.922909 32172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:43.946386 32172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:43.949759 32172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:43.949966 32172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:43.957543 32172 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:44679
I20260810 06:30:43.957832 32281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:44679 every 8 connection(s)
I20260810 06:30:43.958695 32172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:43.960954 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 32172
I20260810 06:30:43.961071 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:43.961361 22287 external_mini_cluster.cc:1428] Setting key 3f3424926b012b3cae6f92c6b51f5802
I20260810 06:30:43.961931 32283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:43.968600 32283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: Bootstrap starting.
Aug 10 06:30:43 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:43.971303 32283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:43.972245 32283 log.cc:824] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:43.974503 32283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: No bootstrap required, opened a new log
I20260810 06:30:43.976354 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:43.962949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51942 (local address 127.21.195.254:44679)
0810 06:30:43.963415 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:43.963432 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:43.963473 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:30:43.964174 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:43.964193 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:43.964567 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:43.964913 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:43.965815 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:43.966863 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:43.967752 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:43.968263 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:43.968421 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:43.971238 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:43.971243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:43.971259 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:43.971293 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:43.973041 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:43.973531 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:43.973539 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:43.973546 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:43.973679 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:43.973970 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:43.973974 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:43.973976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:43.974423 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:43.974626 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:43.974942 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 06:30:43.975299 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":152,"threads_started":1}
I20260810 06:30:43.977967 32283 raft_consensus.cc:348] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } }
I20260810 06:30:43.978237 32283 raft_consensus.cc:374] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:43.978298 32283 raft_consensus.cc:729] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b11382a7a35f4ccfbd1cd73ef150e1df, State: Initialized, Role: FOLLOWER
I20260810 06:30:43.978803 32283 consensus_queue.cc:260] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } }
I20260810 06:30:43.978999 32283 raft_consensus.cc:388] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:43.979072 32283 raft_consensus.cc:482] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:43.979174 32283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:43.980183 32283 raft_consensus.cc:504] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } }
I20260810 06:30:43.980545 32283 leader_election.cc:302] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b11382a7a35f4ccfbd1cd73ef150e1df; no voters:
I20260810 06:30:43.980919 32283 leader_election.cc:288] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:43.981048 32288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:43.981302 32288 raft_consensus.cc:686] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 1 LEADER]: Becoming Leader. State: Replica: b11382a7a35f4ccfbd1cd73ef150e1df, State: Running, Role: LEADER
I20260810 06:30:43.981673 32288 consensus_queue.cc:237] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } }
I20260810 06:30:43.982322 32283 sys_catalog.cc:564] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:43.983623 32291 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } }
I20260810 06:30:43.983762 32291 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:43.984026 32292 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: New leader b11382a7a35f4ccfbd1cd73ef150e1df. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } }
I20260810 06:30:43.984160 32292 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
W20260810 06:30:43.987673 32312 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:30:43.987753 32312 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:30:43.987812 32301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:43.988536 32301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:43.994593 32301 catalog_manager.cc:1347] Generated new cluster ID: c6d1955a697a485fb28a910913571718
I20260810 06:30:43.994683 32301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:44.021318 32301 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:44.022409 32301 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:44.028510 32301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: Generated new TSK 0
I20260810 06:30:44.029345 32301 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab.
Entry for principal oryx/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab.
I20260810 06:30:44.066723 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44679
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab
--principal=oryx/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:44.191980 32323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:44.192325 32323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:44.192369 32323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:44.196687 32323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:44.196784 32323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:44.196856 32323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:44.202664 32323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab
--principal=oryx/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:44.203891 32323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:44.205080 32323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:44.216234 32331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:44.216238 32336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:44.216234 32334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:44.216490 32323 server_base.cc:1034] running on GCE node
I20260810 06:30:44.217079 32323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:44.217953 32323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:44.219142 32323 hybrid_clock.cc:648] HybridClock initialized: now 1786343444219116 us; error 40 us; skew 500 ppm
Aug 10 06:30:44 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:44.222338 32323 init.cc:377] Logged in from keytab as oryx/127.21.195.193@KRBTEST.COM (short username oryx)
I20260810 06:30:44.223393 32323 webserver.cc:460] Webserver started at http://127.21.195.193:36261/ using document root <none> and password file <none>
I20260810 06:30:44.224020 32323 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:44.224090 32323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:44.224515 32323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:44.227782 32323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "1ded8b07f419469788803f6960172b07"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "ff02769591b83d03ef39850eeac4f47a"
server_key_iv: "cb4173d1a6c761876c66364c7db56749"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.228577 32323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "1ded8b07f419469788803f6960172b07"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "ff02769591b83d03ef39850eeac4f47a"
server_key_iv: "cb4173d1a6c761876c66364c7db56749"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.235646 32323 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260810 06:30:44.238963 32347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.240530 32323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:30:44.240694 32323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "1ded8b07f419469788803f6960172b07"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "ff02769591b83d03ef39850eeac4f47a"
server_key_iv: "cb4173d1a6c761876c66364c7db56749"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.240852 32323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:44.266634 32323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:44.270349 32323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:44.270591 32323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:44.271303 32323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:44.272308 32323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:44.272359 32323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.272406 32323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:44.272435 32323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.281925 32323 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:39089
I20260810 06:30:44.281963 32532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:39089 every 8 connection(s)
I20260810 06:30:44.283061 32323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:44.285682 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 32323
I20260810 06:30:44.285796 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:44.286162 22287 external_mini_cluster.cc:1428] Setting key d5285cbfbb921729c513af24c0eede50
Aug 10 06:30:44 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:44.299777 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:44.285117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:35259 (local address 127.21.195.254:44679)
0810 06:30:44.285273 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:44.285278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:44.286494 (+ 1216us) server_negotiation.cc:407] Connection header received
0810 06:30:44.288168 (+ 1674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:44.288172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:44.288221 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:44.288290 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:44.290056 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.290864 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.292336 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.292587 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.292677 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:44.295790 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:44.295793 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:44.295795 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:44.295825 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:44.297290 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:44.297921 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:44.297924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:44.297925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:44.298021 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:44.298403 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:44.298406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:44.298407 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:44.298633 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:44.298728 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:44.299418 (+ 690us) server_negotiation.cc:299] Negotiation successful
0810 06:30:44.299589 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.194@KRBTEST.COM" created.
I20260810 06:30:44.300879 32536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:44.285662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.193:35259)
0810 06:30:44.286270 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:44.286353 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:44.287926 (+ 1573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:44.288517 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:44.288527 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:44.289056 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:44.289862 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:44.289887 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.290997 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.291000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:44.292200 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:44.292214 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.292758 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.292762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:44.292987 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:44.293770 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:44.293792 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:44.295586 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:44.297425 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:44.297432 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:44.297455 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:44.297800 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:44.298114 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:44.298117 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:44.298119 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:44.298295 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:44.298747 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:44.298755 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:44.299147 (+ 392us) client_negotiation.cc:769] Sending connection context
0810 06:30:44.299345 (+ 198us) client_negotiation.cc:240] Negotiation successful
0810 06:30:44.299745 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":161,"threads_started":1}
I20260810 06:30:44.302322 32533 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44679
I20260810 06:30:44.302608 32533 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:44.303167 32533 heartbeater.cc:511] Master 127.21.195.254:44679 requested a full tablet report, sending...
I20260810 06:30:44.304876 32229 ts_manager.cc:194] Registered new tserver with Master: 1ded8b07f419469788803f6960172b07 (127.21.195.193:39089)
I20260810 06:30:44.306143 32229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:35259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab.
Entry for principal oryx/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab.
I20260810 06:30:44.316227 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44679
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab
--principal=oryx/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:44.441329 32546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:44.441717 32546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:44.441771 32546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:44.446148 32546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:44.446231 32546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:44.446295 32546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:44.452085 32546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab
--principal=oryx/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:44.453328 32546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:44.454563 32546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:44.465678 32554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:44.465679 32555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:44.465678 32558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:44.465940 32546 server_base.cc:1034] running on GCE node
I20260810 06:30:44.466418 32546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:44.467178 32546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:44.468355 32546 hybrid_clock.cc:648] HybridClock initialized: now 1786343444468332 us; error 34 us; skew 500 ppm
Aug 10 06:30:44 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:44.471462 32546 init.cc:377] Logged in from keytab as oryx/127.21.195.194@KRBTEST.COM (short username oryx)
I20260810 06:30:44.472471 32546 webserver.cc:460] Webserver started at http://127.21.195.194:43367/ using document root <none> and password file <none>
I20260810 06:30:44.473067 32546 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:44.473136 32546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:44.473495 32546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:44.475863 32546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "061f017a96d740a191b5ffd328739270"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "4362fc13d9ff54269c0df92848f215c8"
server_key_iv: "47cf96bb5e49483e2658efaa94238cc0"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.476508 32546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "061f017a96d740a191b5ffd328739270"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "4362fc13d9ff54269c0df92848f215c8"
server_key_iv: "47cf96bb5e49483e2658efaa94238cc0"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.481204 32546 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260810 06:30:44.484310 32577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.485829 32546 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:44.485970 32546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "061f017a96d740a191b5ffd328739270"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "4362fc13d9ff54269c0df92848f215c8"
server_key_iv: "47cf96bb5e49483e2658efaa94238cc0"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.486095 32546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:44.520532 32546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:44.524045 32546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:44.524264 32546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:44.524966 32546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:44.525947 32546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:44.526001 32546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.526059 32546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:44.526088 32546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.535348 32546 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:35697
I20260810 06:30:44.535423 310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:35697 every 8 connection(s)
I20260810 06:30:44.536422 32546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:44.544668 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 32546
I20260810 06:30:44.544776 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:44.545081 22287 external_mini_cluster.cc:1428] Setting key 6948d639f3d57e0cb627d30262d83fe2
Aug 10 06:30:44 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:44.551882 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:44.538555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:38333 (local address 127.21.195.254:44679)
0810 06:30:44.538695 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:44.538699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:44.539705 (+ 1006us) server_negotiation.cc:407] Connection header received
0810 06:30:44.541241 (+ 1536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:44.541245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:44.541311 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:44.541390 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:44.542841 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.543392 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.544641 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.544967 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.545084 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:44.548051 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:44.548054 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:44.548056 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:44.548084 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:44.549468 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:44.550052 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:44.550056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:44.550057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:44.550146 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:44.550590 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:44.550593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:44.550595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:44.550824 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:44.550928 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:44.551610 (+ 682us) server_negotiation.cc:299] Negotiation successful
0810 06:30:44.551740 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:30:44.553282 315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:44.539025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.194:38333)
0810 06:30:44.539538 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:44.539589 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:44.540998 (+ 1409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:44.541643 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:44.541652 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:44.542077 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:44.542673 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:44.542688 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.543540 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.543543 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:44.544504 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:44.544515 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.545150 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.545155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:44.545336 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:44.546106 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:44.546128 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:44.547856 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:44.549614 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:44.549621 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:44.549642 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:44.549946 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:44.550241 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:44.550245 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:44.550246 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:44.550447 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:44.550945 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:44.550953 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:44.551337 (+ 384us) client_negotiation.cc:769] Sending connection context
0810 06:30:44.551582 (+ 245us) client_negotiation.cc:240] Negotiation successful
0810 06:30:44.552019 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":117,"threads_started":1}
I20260810 06:30:44.554827 311 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44679
I20260810 06:30:44.555123 311 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:44.555702 311 heartbeater.cc:511] Master 127.21.195.254:44679 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:30:44.556967 32229 ts_manager.cc:194] Registered new tserver with Master: 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697)
I20260810 06:30:44.557688 32229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:38333
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab.
Entry for principal oryx/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab.
I20260810 06:30:44.574156 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44679
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab
--principal=oryx/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:44.699958 320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:44.700268 320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:44.700315 320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:44.704725 320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:44.704810 320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:44.704881 320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:44.710659 320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab
--principal=oryx/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:44.712009 320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:44.713146 320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:44.723946 326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:44.723932 325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:44.723935 329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:44.724166 320 server_base.cc:1034] running on GCE node
I20260810 06:30:44.724823 320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:44.725594 320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:44.726795 320 hybrid_clock.cc:648] HybridClock initialized: now 1786343444726763 us; error 42 us; skew 500 ppm
Aug 10 06:30:44 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:44.729903 320 init.cc:377] Logged in from keytab as oryx/127.21.195.195@KRBTEST.COM (short username oryx)
I20260810 06:30:44.730996 320 webserver.cc:460] Webserver started at http://127.21.195.195:32981/ using document root <none> and password file <none>
I20260810 06:30:44.731609 320 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:44.731684 320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:44.731950 320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:44.734373 320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "496083a81d6246a585fc3c85be0c6d39"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "28ad3e3bfe20b9d0fb71117ad442ffae"
server_key_iv: "6b91b07a96598266b662f7e5803f0ef0"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.735020 320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "496083a81d6246a585fc3c85be0c6d39"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "28ad3e3bfe20b9d0fb71117ad442ffae"
server_key_iv: "6b91b07a96598266b662f7e5803f0ef0"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.739435 320 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260810 06:30:44.742240 338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.743619 320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:44.743752 320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "496083a81d6246a585fc3c85be0c6d39"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "28ad3e3bfe20b9d0fb71117ad442ffae"
server_key_iv: "6b91b07a96598266b662f7e5803f0ef0"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.743865 320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:44.753993 320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:44.757467 320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:44.757722 320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:44.758422 320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:44.759390 320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:44.759444 320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.759505 320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:44.759531 320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.768493 320 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:44199
I20260810 06:30:44.768587 535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:44199 every 8 connection(s)
I20260810 06:30:44.769574 320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:44.772766 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 320
I20260810 06:30:44.772902 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:44.773233 22287 external_mini_cluster.cc:1428] Setting key 02871411d40a93fad15b3b50fe68d584
Aug 10 06:30:44 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:44.784435 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:44.771674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:41723 (local address 127.21.195.254:44679)
0810 06:30:44.771813 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:44.771817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:44.772862 (+ 1045us) server_negotiation.cc:407] Connection header received
0810 06:30:44.774573 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:44.774576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:44.774637 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:44.774729 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:44.776230 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.776799 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.778120 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.778372 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.778476 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:44.781073 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:44.781076 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:44.781079 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:44.781107 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:44.782428 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:44.782919 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:44.782922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:44.782925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:44.783022 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:44.783343 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:44.783345 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:44.783346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:44.783540 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:44.783617 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:44.784137 (+ 520us) server_negotiation.cc:299] Negotiation successful
0810 06:30:44.784293 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:30:44.785331 538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:44.772101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.195:41723)
0810 06:30:44.772637 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:44.772709 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:44.774323 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:44.774933 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:44.774943 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:44.775355 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:44.776050 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:44.776069 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.776921 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.776923 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:44.777951 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:44.777962 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:44.778525 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:44.778528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:44.778681 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:44.779293 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:44.779311 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:44.780885 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:44.782538 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:44.782543 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:44.782559 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:44.782838 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:44.783109 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:44.783112 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:44.783113 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:44.783271 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:44.783616 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:44.783621 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:44.783897 (+ 276us) client_negotiation.cc:769] Sending connection context
0810 06:30:44.784081 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 06:30:44.784406 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":136,"threads_started":1}
I20260810 06:30:44.786914 536 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44679
I20260810 06:30:44.787245 536 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:44.787932 536 heartbeater.cc:511] Master 127.21.195.254:44679 requested a full tablet report, sending...
I20260810 06:30:44.789137 32229 ts_manager.cc:194] Registered new tserver with Master: 496083a81d6246a585fc3c85be0c6d39 (127.21.195.195:44199)
I20260810 06:30:44.789997 32229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:41723
I20260810 06:30:44.800220 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.21.195.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.253.keytab.
Entry for principal oryx/127.21.195.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.253.keytab.
I20260810 06:30:44.829665 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.253:37987
--webserver_interface=127.21.195.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.253.keytab
--principal=oryx/127.21.195.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:44679,127.21.195.253:37987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:44.956043 542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:44.956374 542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:44.956416 542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:44.960757 542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:44.960851 542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:44.960870 542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:44.960886 542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:44.960901 542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:44.966745 542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:44679,127.21.195.253:37987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.253.keytab
--principal=oryx/127.21.195.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.253:37987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.195.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
W20260810 06:30:44.967038 542 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.21.195.254:44679,127.21.195.253:37987'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 06:30:44.968060 542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:44.969223 542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:44.978634 554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:44.978645 552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:44.978771 542 server_base.cc:1034] running on GCE node
W20260810 06:30:44.978665 556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:44.979573 542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:44.980858 542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:44.982020 542 hybrid_clock.cc:648] HybridClock initialized: now 1786343444981998 us; error 39 us; skew 500 ppm
Aug 10 06:30:44 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:44.985249 542 init.cc:377] Logged in from keytab as oryx/127.21.195.253@KRBTEST.COM (short username oryx)
I20260810 06:30:44.986330 542 webserver.cc:460] Webserver started at http://127.21.195.253:33493/ using document root <none> and password file <none>
I20260810 06:30:44.986954 542 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:44.987032 542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:44.987267 542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:44.989655 542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data/instance:
uuid: "6c4db3e4436c4348978cdc30dd27112a"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "9126f69251756d19565365050ba9b55d"
server_key_iv: "66c4be1a7afdbfb322c74a2c5e71acc8"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.990411 542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal/instance:
uuid: "6c4db3e4436c4348978cdc30dd27112a"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "9126f69251756d19565365050ba9b55d"
server_key_iv: "66c4be1a7afdbfb322c74a2c5e71acc8"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.994683 542 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:44.997568 567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:44.998982 542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:44.999136 542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
uuid: "6c4db3e4436c4348978cdc30dd27112a"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "9126f69251756d19565365050ba9b55d"
server_key_iv: "66c4be1a7afdbfb322c74a2c5e71acc8"
server_key_version: "encryptionkey@0"
I20260810 06:30:44.999257 542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:45.010237 542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:45.013976 542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:45.014179 542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:45.021538 542 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.253:37987
I20260810 06:30:45.021809 655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.253:37987 every 8 connection(s)
I20260810 06:30:45.022714 542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
I20260810 06:30:45.026000 656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:45.028007 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 542
I20260810 06:30:45.031177 656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.195.253@KRBTEST.COM
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.253@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:45.043260 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.033340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51952 (local address 127.21.195.254:44679)
0810 06:30:45.033546 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.033552 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.033880 (+ 328us) server_negotiation.cc:407] Connection header received
0810 06:30:45.034021 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.034025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.034076 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.034146 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.034898 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.035527 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.036591 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.036898 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.036997 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.039542 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.039546 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.039549 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.039583 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.040968 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.041541 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.041544 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.041545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.041656 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.042027 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.042031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.042034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.042397 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.042516 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.042918 (+ 402us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.043073 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 06:30:45.044219 661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.029779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.21.195.253:37987)
0810 06:30:45.030250 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.030271 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.030317 (+ 46us) server_negotiation.cc:407] Connection header received
0810 06:30:45.031206 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.031234 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.031714 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.032130 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.032874 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.034264 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.035269 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.035858 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.036039 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.039066 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.039074 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.039088 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.039117 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.040978 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.041509 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.041540 (+ 31us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.041542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.041698 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.042027 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.042031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.042034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.042613 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.042773 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.043040 (+ 267us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.043521 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":265,"server-negotiator.queue_time_us":307,"thread_start_us":115,"threads_started":1}
I20260810 06:30:45.044221 662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.033260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:51952)
0810 06:30:45.033743 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.033798 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.033928 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.034217 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.034223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.034643 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.034767 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.034773 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.035658 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.035661 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.036467 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.036476 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.037058 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.037062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.037158 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.037724 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.037745 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.039381 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.041090 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.041102 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.041116 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.041411 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.041740 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.041743 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.041745 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.041913 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.042507 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.042513 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.042658 (+ 145us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.042853 (+ 195us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.043233 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":166,"threads_started":1}
I20260810 06:30:45.045873 656 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343444, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.253@KRBTEST.COM for oryx/127.21.195.253@KRBTEST.COM
I20260810 06:30:45.053817 662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.046427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.0.0.1:51554)
0810 06:30:45.046537 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.046552 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.046623 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.046841 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.046844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.047014 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.047116 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.047121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.048196 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.048199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.048791 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.048800 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.049203 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.049205 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.049308 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.049793 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.049805 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.051111 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.052545 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.052548 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.052549 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.052741 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.052951 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.052953 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.052955 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.053021 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.053312 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.053314 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.053394 (+ 80us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.053476 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.053632 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":16}
I20260810 06:30:45.053820 661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.046493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51554 (local address 127.21.195.253:37987)
0810 06:30:45.046600 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.046604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.046619 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:45.046696 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.046699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.046740 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.046816 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.047205 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.048093 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.048893 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.049121 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.049195 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.051244 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.051247 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.051249 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.051270 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.052443 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.052812 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.052815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.052817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.052888 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.053079 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.053081 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.053082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.053250 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.053329 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.053578 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.053682 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":44}
I20260810 06:30:45.057026 656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Bootstrap starting.
I20260810 06:30:45.059705 656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:45.060537 656 log.cc:824] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:45.062845 656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: No bootstrap required, opened a new log
I20260810 06:30:45.066118 656 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } }
I20260810 06:30:45.066378 656 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:45.066440 656 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c4db3e4436c4348978cdc30dd27112a, State: Initialized, Role: FOLLOWER
I20260810 06:30:45.066927 656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } }
I20260810 06:30:45.067452 671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } } }
I20260810 06:30:45.067585 671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:30:45.068282 656 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: configured and running, proceeding with master startup.
W20260810 06:30:45.073587 691 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:30:45.073704 691 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:30:45.076424 542 master_runner.cc:428] Detected that this master 6c4db3e4436c4348978cdc30dd27112a is joining an existing cluster
I20260810 06:30:45.076512 542 master_runner.cc:432] Initiating AddMaster RPC to add 127.21.195.253:37987
I20260810 06:30:45.088268 661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.079767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51564 (local address 127.21.195.253:37987)
0810 06:30:45.079896 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.079901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.080255 (+ 354us) server_negotiation.cc:407] Connection header received
0810 06:30:45.080354 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.080357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.080404 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.080498 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.080939 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.081413 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.082512 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.082912 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.083019 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.084925 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.084929 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.084932 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.084957 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.086677 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.087089 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.087092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.087094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.087167 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.087417 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.087420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.087423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.087636 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.087734 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.087983 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.088113 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":53}
I20260810 06:30:45.088374 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.079306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51968 (local address 127.21.195.254:44679)
0810 06:30:45.079468 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.079473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.079734 (+ 261us) server_negotiation.cc:407] Connection header received
0810 06:30:45.079951 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.079955 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.080013 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.080072 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.080850 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.081706 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.082766 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.083021 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.083117 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.084517 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.084521 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.084524 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.084557 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.086181 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.086688 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.086691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.086693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.086794 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.087082 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.087086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.087087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.087332 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.087428 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.088066 (+ 638us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.088203 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:30:45.088280 702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.079694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.0.0.1:51564)
0810 06:30:45.080168 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.080182 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.080267 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.080532 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.080534 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.080731 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.080846 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.080852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.081556 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.081559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.082389 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.082398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.083043 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.083047 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.083137 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.083768 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.083785 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.084356 (+ 571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.086773 (+ 2417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.086776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.086778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.087002 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.087255 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.087257 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.087259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.087333 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.087727 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.087730 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.087810 (+ 80us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.087901 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.088061 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"spinlock_wait_cycles":6912,"thread_start_us":93,"threads_started":1}
I20260810 06:30:45.088929 700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.079203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:51968)
0810 06:30:45.079650 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.079665 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.079822 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.080243 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.080246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.080498 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.080692 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.080699 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.081840 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.081844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.082615 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.082674 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.083262 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.083265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.083347 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.083889 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.083901 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.084356 (+ 455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.086289 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.086292 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.086294 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.086595 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.086885 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.086888 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.086890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.086988 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.087769 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.087772 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.087870 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.088585 (+ 715us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.088738 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":107,"threads_started":1}
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343443, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.254@KRBTEST.COM for oryx/127.21.195.253@KRBTEST.COM
I20260810 06:30:45.105038 661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.094227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51566 (local address 127.21.195.253:37987)
0810 06:30:45.094337 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.094342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.094716 (+ 374us) server_negotiation.cc:407] Connection header received
0810 06:30:45.094917 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.094919 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.094971 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.095039 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.095758 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.096262 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.097211 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.097478 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.097613 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.100894 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.100898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.100901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.100932 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.102638 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.103256 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.103260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.103262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.103375 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.103793 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.103796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.103798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.104072 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.104187 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.104718 (+ 531us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.104860 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 06:30:45.105067 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.094204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.0.0.1:51566)
0810 06:30:45.094585 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.094635 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.094780 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.095095 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.095103 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.095512 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.095636 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.095643 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.096369 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.096373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.097085 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.097097 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.097732 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.097734 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.097829 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.098555 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.098571 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.100719 (+ 2148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.102770 (+ 2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.102785 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.102793 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.103154 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.103577 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.103580 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.103582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.103695 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.104190 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.104199 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.104363 (+ 164us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.104618 (+ 255us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.104870 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":106,"threads_started":1}
I20260810 06:30:45.107191 32229 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.21.195.253:37987: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a"
member_type: NON_VOTER
last_known_addr {
host: "127.21.195.253"
port: 37987
}
attrs {
promote: true
}
}
dest_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df"
cas_config_opid_index: -1
I20260810 06:30:45.108191 32229 consensus_queue.cc:237] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } }
WARNING: no policy specified for oryx/127.21.195.252@KRBTEST.COM; defaulting to no policy
I20260810 06:30:45.110601 710 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 6c4db3e4436c4348978cdc30dd27112a (127.21.195.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } }
I20260810 06:30:45.111435 609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.252@KRBTEST.COM" created.
I20260810 06:30:45.112422 710 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.21.195.253:37987
I20260810 06:30:45.113004 609 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Refusing update from remote peer b11382a7a35f4ccfbd1cd73ef150e1df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 06:30:45.113026 709 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } }
I20260810 06:30:45.113139 709 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:45.113803 709 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:45.113889 542 master.cc:537] Master@127.21.195.253:37987 shutting down...
W20260810 06:30:45.116075 32207 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260810 06:30:45.117086 32207 consensus_peers.cc:487] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df -> Peer 6c4db3e4436c4348978cdc30dd27112a (127.21.195.253:37987): Couldn't send request to peer 6c4db3e4436c4348978cdc30dd27112a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 06:30:45.119115 542 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:45.119506 542 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:45.119639 542 tablet_replica.cc:330] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.252.keytab.
Entry for principal oryx/127.21.195.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.252.keytab.
I20260810 06:30:45.131006 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.252:45361
--webserver_interface=127.21.195.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.252.keytab
--principal=oryx/127.21.195.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:44679,127.21.195.253:37987,127.21.195.252:45361
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:30:45.136561 542 master.cc:552] Master@127.21.195.253:37987 shutdown complete.
I20260810 06:30:45.136646 542 master_runner.cc:305] Clearing existing system tablet
I20260810 06:30:45.136983 542 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:45.137064 542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:45.138728 542 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:45.139746 719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.140071 542 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:45.140218 542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:45.140254 542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
uuid: "6c4db3e4436c4348978cdc30dd27112a"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "9126f69251756d19565365050ba9b55d"
server_key_iv: "66c4be1a7afdbfb322c74a2c5e71acc8"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.142735 542 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:45.145557 542 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 06:30:45.145673 542 log.cc:1196] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 06:30:45.145948 542 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Deleting consensus metadata
I20260810 06:30:45.146137 542 master_runner.cc:315] Copying system tablet from 127.21.195.254:44679
I20260810 06:30:45.147802 542 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: tablet copy: Beginning tablet copy session from remote peer at address 127.21.195.254:44679
I20260810 06:30:45.157625 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.148550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:51982)
0810 06:30:45.149018 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.149035 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.149173 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.149502 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.149505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.149793 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.149934 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.149943 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.151077 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.151081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.151952 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.151965 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.152589 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.152593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.152701 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.153283 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.153298 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.153801 (+ 503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.155802 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.155806 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.155808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.156090 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.156400 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.156403 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.156405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.156502 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.156961 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.156964 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.157093 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.157200 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.157365 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":109,"threads_started":1}
I20260810 06:30:45.157626 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.148683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51982 (local address 127.21.195.254:44679)
0810 06:30:45.148848 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.148853 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.149145 (+ 292us) server_negotiation.cc:407] Connection header received
0810 06:30:45.149303 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.149307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.149378 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.149471 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.150076 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.150954 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.152092 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.152464 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.152572 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.153976 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.153981 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.153984 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.154016 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.155675 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.156198 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.156202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.156204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.156311 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.156594 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.156597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.156599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.156866 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.156968 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.157266 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.157406 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 06:30:45.158743 32261 tablet_copy_service.cc:140] P b11382a7a35f4ccfbd1cd73ef150e1df: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 6c4db3e4436c4348978cdc30dd27112a ({username='oryx', principal='oryx/127.21.195.253@KRBTEST.COM'} at 127.0.0.1:51982)
I20260810 06:30:45.158972 32261 tablet_copy_service.cc:161] P b11382a7a35f4ccfbd1cd73ef150e1df: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 6c4db3e4436c4348978cdc30dd27112a at {username='oryx', principal='oryx/127.21.195.253@KRBTEST.COM'} at 127.0.0.1:51982: session id = 6c4db3e4436c4348978cdc30dd27112a-00000000000000000000000000000000
I20260810 06:30:45.161123 32261 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 06:30:45.163395 542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 06:30:45.166250 542 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: tablet copy: Starting download of 0 data blocks...
I20260810 06:30:45.166481 542 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: tablet copy: Starting download of 1 WAL segments...
I20260810 06:30:45.168597 542 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 06:30:45.170869 32261 tablet_copy_service.cc:342] P b11382a7a35f4ccfbd1cd73ef150e1df: Request end of tablet copy session 6c4db3e4436c4348978cdc30dd27112a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.21.195.253@KRBTEST.COM'} at 127.0.0.1:51982
I20260810 06:30:45.171041 32261 tablet_copy_service.cc:433] P b11382a7a35f4ccfbd1cd73ef150e1df: ending tablet copy session 6c4db3e4436c4348978cdc30dd27112a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 6c4db3e4436c4348978cdc30dd27112a
I20260810 06:30:45.179982 542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:45.181905 733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:45.181900 730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:45.181900 738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:45.182520 542 server_base.cc:1034] running on GCE node
I20260810 06:30:45.182708 542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:45.183032 542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:45.184181 542 hybrid_clock.cc:648] HybridClock initialized: now 1786343445184152 us; error 46 us; skew 500 ppm
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:45.185976 542 init.cc:377] Logged in from keytab as oryx/127.21.195.253@KRBTEST.COM (short username oryx)
I20260810 06:30:45.186533 542 webserver.cc:460] Webserver started at http://127.21.195.253:38633/ using document root <none> and password file <none>
I20260810 06:30:45.186733 542 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:45.186769 542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:45.188272 542 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:45.189378 749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.189700 542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:45.189782 542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
uuid: "6c4db3e4436c4348978cdc30dd27112a"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "9126f69251756d19565365050ba9b55d"
server_key_iv: "66c4be1a7afdbfb322c74a2c5e71acc8"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.189870 542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:45.206907 542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:45.209597 542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:45.215381 542 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.253:37987
I20260810 06:30:45.215411 829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.253:37987 every 8 connection(s)
I20260810 06:30:45.216362 542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
I20260810 06:30:45.218721 830 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:30:45.219877 830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Bootstrap starting.
I20260810 06:30:45.232368 830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:30:45.232730 830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: Bootstrap complete.
I20260810 06:30:45.233376 830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } }
I20260810 06:30:45.233551 830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6c4db3e4436c4348978cdc30dd27112a, State: Initialized, Role: LEARNER
I20260810 06:30:45.233667 830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } }
I20260810 06:30:45.234100 833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } }
I20260810 06:30:45.234211 830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:45.234368 833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: This master's current role is: LEARNER
I20260810 06:30:45.237705 855 catalog_manager.cc:1259] Loaded cluster ID: c6d1955a697a485fb28a910913571718
I20260810 06:30:45.237901 855 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: loading cluster ID for follower catalog manager: success
I20260810 06:30:45.240437 855 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: acquiring CA information for follower catalog manager: success
I20260810 06:30:45.242384 855 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 06:30:45.283981 716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:45.284351 716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:45.284420 716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:45.288899 716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:45.288993 716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:45.289016 716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:45.289039 716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:45.289073 716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:45.295171 716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:44679,127.21.195.253:37987,127.21.195.252:45361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.252.keytab
--principal=oryx/127.21.195.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.252:45361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.195.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:45.296478 716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:45.297772 716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:45.307554 870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:45.307535 867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:45.307535 865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:45.307934 716 server_base.cc:1034] running on GCE node
I20260810 06:30:45.308607 716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:45.308718 32533 heartbeater.cc:503] Master 127.21.195.254:44679 was elected leader, sending a full tablet report...
I20260810 06:30:45.310269 716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:45.311489 716 hybrid_clock.cc:648] HybridClock initialized: now 1786343445311448 us; error 59 us; skew 500 ppm
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:45.314577 716 init.cc:377] Logged in from keytab as oryx/127.21.195.252@KRBTEST.COM (short username oryx)
I20260810 06:30:45.315569 716 webserver.cc:460] Webserver started at http://127.21.195.252:45909/ using document root <none> and password file <none>
I20260810 06:30:45.316162 716 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:45.316227 716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:45.316412 716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:45.318976 716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data/instance:
uuid: "65ba81615c5042ecb443658951d971c6"
format_stamp: "Formatted at 2026-08-10 06:30:45 on dist-test-slave-7lbf"
server_key: "7f424d609febb1da8f06b191c342ac1c"
server_key_iv: "58a90d2540c17d54448d17eac76fb5ac"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.319720 716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal/instance:
uuid: "65ba81615c5042ecb443658951d971c6"
format_stamp: "Formatted at 2026-08-10 06:30:45 on dist-test-slave-7lbf"
server_key: "7f424d609febb1da8f06b191c342ac1c"
server_key_iv: "58a90d2540c17d54448d17eac76fb5ac"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.324307 716 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 06:30:45.327225 881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.328742 716 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:45.328876 716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
uuid: "65ba81615c5042ecb443658951d971c6"
format_stamp: "Formatted at 2026-08-10 06:30:45 on dist-test-slave-7lbf"
server_key: "7f424d609febb1da8f06b191c342ac1c"
server_key_iv: "58a90d2540c17d54448d17eac76fb5ac"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.329010 716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:45.356709 716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:45.360687 716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:45.360936 716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:45.370951 716 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.252:45361
I20260810 06:30:45.371243 967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.252:45361 every 8 connection(s)
I20260810 06:30:45.372198 716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
I20260810 06:30:45.375505 969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:45.380474 969 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:30:45.381398 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 716
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.252@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343443, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.195.252@KRBTEST.COM
I20260810 06:30:45.395208 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.382805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51996 (local address 127.21.195.254:44679)
0810 06:30:45.382936 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.382941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.383819 (+ 878us) server_negotiation.cc:407] Connection header received
0810 06:30:45.384840 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.384843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.384904 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.385011 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.386088 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.386642 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.387758 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.388016 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.388147 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.391107 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.391110 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.391112 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.391144 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.392729 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.393399 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.393404 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.393405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.393509 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.393915 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.393919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.393921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.394144 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.394246 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.394860 (+ 614us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.395010 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:30:45.396129 971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.382954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57582 (local address 127.21.195.252:45361)
0810 06:30:45.383518 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.383558 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.383606 (+ 48us) server_negotiation.cc:407] Connection header received
0810 06:30:45.384553 (+ 947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.384584 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.384859 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.385043 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.385989 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.386860 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.387753 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.388183 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.388335 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.391595 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.391604 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.391622 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.391651 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.393318 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.393824 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.393831 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.393833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.393910 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.394195 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.394199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.394201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.394591 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.394789 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.395025 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.395367 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":171,"server-negotiator.queue_time_us":419,"spinlock_wait_cycles":6400,"thread_start_us":190,"threads_started":1}
I20260810 06:30:45.396131 972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.382954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:51996)
0810 06:30:45.383655 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.383709 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.384553 (+ 844us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.385141 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.385148 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.385599 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.385917 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.385934 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.386815 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.386818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.387618 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.387628 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.388189 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.388193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.388335 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.389008 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.389027 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.390942 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.392879 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.392890 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.392903 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.393283 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.393634 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.393638 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.393640 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.393813 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.394264 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.394272 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.394604 (+ 332us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.394787 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.395170 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":24,"spinlock_wait_cycles":31872,"thread_start_us":190,"threads_started":1}
I20260810 06:30:45.397538 969 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.252@KRBTEST.COM for oryx/127.21.195.253@KRBTEST.COM
I20260810 06:30:45.405699 972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.398104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.0.0.1:51582)
0810 06:30:45.398214 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.398228 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.398301 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.398720 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.398722 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.398859 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.398984 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.398990 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.399855 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.399857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.400391 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.400397 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.400907 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.400909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.400983 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.401501 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.401559 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.402771 (+ 1212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.404375 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.404377 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.404379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.404577 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.404830 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.404832 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.404833 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.404899 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.405241 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.405243 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.405327 (+ 84us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.405401 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.405557 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 06:30:45.405756 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.398218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51582 (local address 127.21.195.253:37987)
0810 06:30:45.398506 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.398509 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.398524 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:45.398565 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.398568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.398610 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.398696 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.399080 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.399771 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.400518 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.400802 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.400900 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.402935 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.402939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.402941 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.402973 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.404268 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.404658 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.404661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.404662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.404753 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.404963 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.404965 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.404966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.405167 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.405248 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.405451 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.405615 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":113,"threads_started":1}
I20260810 06:30:45.406512 969 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.252@KRBTEST.COM for oryx/127.21.195.252@KRBTEST.COM
I20260810 06:30:45.413890 972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.407044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.0.0.1:57586)
0810 06:30:45.407164 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.407178 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.407249 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.407446 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.407447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.407599 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.407677 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.407682 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.408381 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.408383 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.408886 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.408893 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.409323 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.409325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.409427 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.409910 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.409925 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.411158 (+ 1233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.412595 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.412597 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.412599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.412785 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.412994 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.412997 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.412998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.413067 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.413372 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.413374 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.413453 (+ 79us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.413590 (+ 137us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.413721 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":26}
I20260810 06:30:45.413928 971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.407122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57586 (local address 127.21.195.252:45361)
0810 06:30:45.407230 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.407234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.407247 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:30:45.407322 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.407325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.407363 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.407421 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.407766 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.408285 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.408970 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.409227 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.409314 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.411306 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.411309 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.411311 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.411333 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.412500 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.412860 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.412862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.412863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.412930 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.413129 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.413130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.413132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.413309 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.413379 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.413650 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.413778 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":42}
I20260810 06:30:45.418040 969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Bootstrap starting.
I20260810 06:30:45.420894 969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:45.422132 969 log.cc:824] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:45.424412 969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: No bootstrap required, opened a new log
I20260810 06:30:45.428712 969 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } }
I20260810 06:30:45.428987 969 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:45.429054 969 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65ba81615c5042ecb443658951d971c6, State: Initialized, Role: FOLLOWER
I20260810 06:30:45.429603 969 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } }
I20260810 06:30:45.430269 981 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } } }
I20260810 06:30:45.430410 981 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:30:45.431284 969 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 06:30:45.437608 1000 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:30:45.437731 1000 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:30:45.441155 716 master_runner.cc:428] Detected that this master 65ba81615c5042ecb443658951d971c6 is joining an existing cluster
I20260810 06:30:45.441231 716 master_runner.cc:432] Initiating AddMaster RPC to add 127.21.195.252:45361
I20260810 06:30:45.449900 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 32323
I20260810 06:30:45.494356 971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.443653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57598 (local address 127.21.195.252:45361)
0810 06:30:45.443774 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.443779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.444642 (+ 863us) server_negotiation.cc:407] Connection header received
0810 06:30:45.444858 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.444861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.444896 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.444941 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.445851 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.446519 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.448277 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.448550 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.448636 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.490696 (+ 42060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.490701 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.490704 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.490731 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.492421 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.492921 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.492925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.492927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.493004 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.493288 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.493291 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.493293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.493587 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.493671 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.494013 (+ 342us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.494160 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":8,"server-negotiator.queue_time_us":45}
I20260810 06:30:45.494619 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.444229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51584 (local address 127.21.195.253:37987)
0810 06:30:45.444596 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.444602 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.444802 (+ 200us) server_negotiation.cc:407] Connection header received
0810 06:30:45.444993 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.444997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.445055 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.445179 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.446095 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.446898 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.448376 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.448756 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.448844 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.490841 (+ 41997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.490846 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.490849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.490898 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.492553 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.493130 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.493135 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.493137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.493287 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.493651 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.493654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.493656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.493889 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.493961 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.494302 (+ 341us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.494457 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282}
I20260810 06:30:45.494971 1012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.443871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.0.0.1:57598)
0810 06:30:45.444566 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.444579 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.444757 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.445083 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.445085 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.445323 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.445668 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.445679 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.446621 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.446624 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.448176 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.448185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.448802 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.448816 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.448902 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.489722 (+ 40820us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.489743 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.490349 (+ 606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.492555 (+ 2206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.492558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.492561 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.492818 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.493103 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.493106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.493108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.493199 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.493734 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.493736 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.493847 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.494618 (+ 771us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.494787 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":77,"thread_start_us":112,"threads_started":1}
I20260810 06:30:45.495163 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.444236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.0.0.1:51584)
0810 06:30:45.444666 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.444689 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.444877 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.445389 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.445392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.445762 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.445944 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.445953 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.447062 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.447065 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.448231 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.448243 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.449016 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.449019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.449122 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.489569 (+ 40447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.489587 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.490666 (+ 1079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.492685 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.492688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.492690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.493003 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.493417 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.493420 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.493422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.493546 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.494030 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.494033 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.494131 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.494817 (+ 686us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.494975 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":56,"spinlock_wait_cycles":1280,"thread_start_us":116,"threads_started":1}
I20260810 06:30:45.497488 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.443691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.21.195.254:44679)
0810 06:30:45.443806 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.443811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.444080 (+ 269us) server_negotiation.cc:407] Connection header received
0810 06:30:45.444286 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.444290 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.444358 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.444411 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.445412 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.446300 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.447744 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.448095 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.448179 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.459144 (+ 10965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.459149 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.459151 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.459188 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.488649 (+ 29461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.490295 (+ 1646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.490300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.490302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.490440 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.496409 (+ 5969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.496414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.496415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.496703 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.496791 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.497169 (+ 378us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.497309 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:30:45.497812 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:39089
--local_ip_for_outbound_sockets=127.21.195.193
--tserver_master_addrs=127.21.195.254:44679
--webserver_port=36261
--webserver_interface=127.21.195.193
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab
--principal=oryx/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987,127.21.195.252:45361 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:30:45.498040 1009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.443609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:52008)
0810 06:30:45.443979 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.443997 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.444169 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.444701 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.444704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.444975 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.445226 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.445249 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.446473 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.446476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.447598 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.447610 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.448511 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.448515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.448639 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.449496 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.449536 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.458893 (+ 9357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.489040 (+ 30147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.489044 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.489047 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.489970 (+ 923us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.491252 (+ 1282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.491256 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.491258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.491743 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.496867 (+ 5124us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.496869 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.496964 (+ 95us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.497671 (+ 707us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.497834 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":294,"thread_start_us":142,"threads_started":1}
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343443, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.254@KRBTEST.COM for oryx/127.21.195.252@KRBTEST.COM
I20260810 06:30:45.515609 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.505107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.0.0.1:57614)
0810 06:30:45.505315 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.505331 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.505436 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.505919 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.505923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.506165 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.506331 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.506342 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.507391 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.507395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.508264 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.508280 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.508908 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.508913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.509036 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.509683 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.509704 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.511513 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.513722 (+ 2209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.513726 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.513728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.514095 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.514433 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.514436 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.514438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.514533 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.514999 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.515002 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.515121 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.515225 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.515411 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260810 06:30:45.515625 971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.505169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57614 (local address 127.21.195.252:45361)
0810 06:30:45.505631 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.505636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.505648 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:30:45.505727 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.505730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.505785 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.505861 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.506484 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.507264 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.508426 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.508775 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.508875 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.511722 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.511727 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.511730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.511774 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.513596 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.514219 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.514223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.514226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.514337 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.514619 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.514622 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.514624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.514895 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.515000 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.515291 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.515436 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384}
I20260810 06:30:45.517452 32229 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.21.195.252:45361: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "65ba81615c5042ecb443658951d971c6"
member_type: NON_VOTER
last_known_addr {
host: "127.21.195.252"
port: 45361
}
attrs {
promote: true
}
}
dest_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df"
cas_config_opid_index: 5
I20260810 06:30:45.518304 32229 consensus_queue.cc:237] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } }
I20260810 06:30:45.519852 710 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 65ba81615c5042ecb443658951d971c6 (127.21.195.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.521798 710 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.21.195.252:45361
I20260810 06:30:45.522020 709 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.522142 709 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:45.522827 922 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:45.525295 922 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Refusing update from remote peer b11382a7a35f4ccfbd1cd73ef150e1df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 06:30:45.526088 709 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:45.527019 716 master.cc:537] Master@127.21.195.252:45361 shutting down...
W20260810 06:30:45.530290 32210 consensus_peers.cc:487] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df -> Peer 65ba81615c5042ecb443658951d971c6 (127.21.195.252:45361): Couldn't send request to peer 65ba81615c5042ecb443658951d971c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 06:30:45.533595 716 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:45.533671 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.519832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51588 (local address 127.21.195.253:37987)
0810 06:30:45.519976 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.519981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.526228 (+ 6247us) server_negotiation.cc:407] Connection header received
0810 06:30:45.526624 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.526628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.526708 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.526800 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:45.528122 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.528942 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.531899 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.532623 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.532806 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.532970 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.533373 (+ 403us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.533488 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:45.534127 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.519693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.0.0.1:51588)
0810 06:30:45.526126 (+ 6433us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.526145 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.526462 (+ 317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.527047 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.527050 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.527143 (+ 93us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:45.527898 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.527909 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.529490 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.529494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.531617 (+ 2123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.531632 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.533040 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.533044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.533152 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.533257 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.533916 (+ 659us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.534010 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6339}
I20260810 06:30:45.534785 789 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 LEARNER]: Refusing update from remote peer b11382a7a35f4ccfbd1cd73ef150e1df: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 06:30:45.535477 709 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 06:30:45.541464 716 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:45.541743 716 tablet_replica.cc:330] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: stopping tablet replica
I20260810 06:30:45.542098 789 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 65ba81615c5042ecb443658951d971c6 (127.21.195.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.544937 833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b11382a7a35f4ccfbd1cd73ef150e1df. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.545104 833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: This master's current role is: LEARNER
I20260810 06:30:45.545212 833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: NON_VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: true } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.545303 833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: This master's current role is: LEARNER
I20260810 06:30:45.546250 709 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: attempting to promote NON_VOTER 6c4db3e4436c4348978cdc30dd27112a to VOTER
I20260810 06:30:45.546859 709 consensus_queue.cc:237] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } }
I20260810 06:30:45.548419 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.548065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.0.0.1:57630)
0810 06:30:45.548234 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.548312 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:45361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260810 06:30:45.548461 789 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 LEARNER]: Refusing update from remote peer b11382a7a35f4ccfbd1cd73ef150e1df: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 06:30:45.549306 1016 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 06:30:45.549563 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.549282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.0.0.1:57632)
0810 06:30:45.549427 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.549473 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:45361: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260810 06:30:45.549765 32210 consensus_peers.cc:487] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df -> Peer 65ba81615c5042ecb443658951d971c6 (127.21.195.252:45361): Couldn't send request to peer 65ba81615c5042ecb443658951d971c6. Status: Network error: Client connection negotiation failed: client connection to 127.21.195.252:45361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 06:30:45.551358 709 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6c4db3e4436c4348978cdc30dd27112a (127.21.195.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.553725 789 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 6c4db3e4436c4348978cdc30dd27112a (127.21.195.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.554152 709 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.554324 709 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:45.554522 709 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.554664 709 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:45.555883 1015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.556041 1015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:30:45.559508 716 master.cc:552] Master@127.21.195.252:45361 shutdown complete.
I20260810 06:30:45.559576 716 master_runner.cc:305] Clearing existing system tablet
I20260810 06:30:45.559831 716 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:45.559898 716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:45.560216 311 heartbeater.cc:503] Master 127.21.195.254:44679 was elected leader, sending a full tablet report...
I20260810 06:30:45.561255 716 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 06:30:45.562232 1022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.562486 716 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:45.562631 716 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:30:45.562680 716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
uuid: "65ba81615c5042ecb443658951d971c6"
format_stamp: "Formatted at 2026-08-10 06:30:45 on dist-test-slave-7lbf"
server_key: "7f424d609febb1da8f06b191c342ac1c"
server_key_iv: "58a90d2540c17d54448d17eac76fb5ac"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.565209 716 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:45.568154 716 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 06:30:45.568275 716 log.cc:1196] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 06:30:45.568573 716 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Deleting consensus metadata
I20260810 06:30:45.568778 716 master_runner.cc:315] Copying system tablet from 127.21.195.254:44679
I20260810 06:30:45.570185 716 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: tablet copy: Beginning tablet copy session from remote peer at address 127.21.195.254:44679
I20260810 06:30:45.580372 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.570982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52018 (local address 127.21.195.254:44679)
0810 06:30:45.571138 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.571143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.571321 (+ 178us) server_negotiation.cc:407] Connection header received
0810 06:30:45.571461 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.571464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.571524 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.571640 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.572219 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.573064 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.574361 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.574714 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.574858 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.576330 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.576335 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.576338 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.576373 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.578289 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.578845 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.578849 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.578851 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.578970 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.579309 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.579312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.579314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.579588 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.579706 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.580043 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.580192 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 06:30:45.580861 1033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.570846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:52018)
0810 06:30:45.571199 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.571216 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.571355 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.571677 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.571680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.571920 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.572068 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.572078 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.573211 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.573215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.574205 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.574219 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.574894 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.574899 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.575001 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.575674 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.575691 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.576141 (+ 450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.578449 (+ 2308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.578452 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.578455 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.578734 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.579086 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.579090 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.579092 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.579204 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.579710 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.579713 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.579845 (+ 132us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.579968 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.580155 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":103,"threads_started":1}
I20260810 06:30:45.581616 32261 tablet_copy_service.cc:140] P b11382a7a35f4ccfbd1cd73ef150e1df: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 65ba81615c5042ecb443658951d971c6 ({username='oryx', principal='oryx/127.21.195.252@KRBTEST.COM'} at 127.0.0.1:52018)
I20260810 06:30:45.581743 32261 tablet_copy_service.cc:161] P b11382a7a35f4ccfbd1cd73ef150e1df: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 65ba81615c5042ecb443658951d971c6 at {username='oryx', principal='oryx/127.21.195.252@KRBTEST.COM'} at 127.0.0.1:52018: session id = 65ba81615c5042ecb443658951d971c6-00000000000000000000000000000000
I20260810 06:30:45.582990 32261 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 06:30:45.584782 716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 06:30:45.587905 716 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: tablet copy: Starting download of 0 data blocks...
I20260810 06:30:45.588299 716 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: tablet copy: Starting download of 1 WAL segments...
I20260810 06:30:45.590728 716 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 06:30:45.593334 32261 tablet_copy_service.cc:342] P b11382a7a35f4ccfbd1cd73ef150e1df: Request end of tablet copy session 65ba81615c5042ecb443658951d971c6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.21.195.252@KRBTEST.COM'} at 127.0.0.1:52018
I20260810 06:30:45.593452 32261 tablet_copy_service.cc:433] P b11382a7a35f4ccfbd1cd73ef150e1df: ending tablet copy session 65ba81615c5042ecb443658951d971c6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 65ba81615c5042ecb443658951d971c6
I20260810 06:30:45.602988 716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:45.604995 1034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:45.605049 1039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:45.605564 716 server_base.cc:1034] running on GCE node
W20260810 06:30:45.606014 1035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:45.606313 716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:45.606655 716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:45.607813 716 hybrid_clock.cc:648] HybridClock initialized: now 1786343445607800 us; error 31 us; skew 500 ppm
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:45.609619 716 init.cc:377] Logged in from keytab as oryx/127.21.195.252@KRBTEST.COM (short username oryx)
I20260810 06:30:45.610143 716 webserver.cc:460] Webserver started at http://127.21.195.252:45743/ using document root <none> and password file <none>
I20260810 06:30:45.610373 716 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:45.610421 716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:45.611923 716 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 06:30:45.612991 1047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.613258 716 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 06:30:45.613333 716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
uuid: "65ba81615c5042ecb443658951d971c6"
format_stamp: "Formatted at 2026-08-10 06:30:45 on dist-test-slave-7lbf"
server_key: "7f424d609febb1da8f06b191c342ac1c"
server_key_iv: "58a90d2540c17d54448d17eac76fb5ac"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.613428 716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:45.639609 716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:45.641650 716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:45.646476 716 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.252:45361
I20260810 06:30:45.647360 1131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.252:45361 every 8 connection(s)
I20260810 06:30:45.647377 716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
I20260810 06:30:45.649444 1133 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:30:45.650792 1133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Bootstrap starting.
W20260810 06:30:45.663055 1013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:45.663476 1013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:45.663570 1013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260810 06:30:45.663700 1133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:30:45.664052 1133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Bootstrap complete.
I20260810 06:30:45.664674 1133 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } }
I20260810 06:30:45.664827 1133 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 65ba81615c5042ecb443658951d971c6, State: Initialized, Role: LEARNER
I20260810 06:30:45.664937 1133 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } }
I20260810 06:30:45.665316 1140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:45.665434 1140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: This master's current role is: LEARNER
I20260810 06:30:45.665441 1133 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:45.668803 1156 catalog_manager.cc:1259] Loaded cluster ID: c6d1955a697a485fb28a910913571718
I20260810 06:30:45.668877 1156 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: loading cluster ID for follower catalog manager: success
W20260810 06:30:45.669324 1013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:45.669386 1013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:45.669452 1013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:45.670646 1156 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: acquiring CA information for follower catalog manager: success
I20260810 06:30:45.671881 1156 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:30:45.675318 1013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab
--principal=oryx/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:39089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=36261
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987,127.21.195.252:45361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:45.676618 1013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:45.677858 1013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:45.688902 1158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:45.688865 1160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:45.689065 1162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:45.689332 1013 server_base.cc:1034] running on GCE node
I20260810 06:30:45.689864 1013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:45.690675 1013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:45.691846 1013 hybrid_clock.cc:648] HybridClock initialized: now 1786343445691816 us; error 46 us; skew 500 ppm
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:45.695132 1013 init.cc:377] Logged in from keytab as oryx/127.21.195.193@KRBTEST.COM (short username oryx)
I20260810 06:30:45.696154 1013 webserver.cc:460] Webserver started at http://127.21.195.193:36261/ using document root <none> and password file <none>
I20260810 06:30:45.696775 1013 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:45.696871 1013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:45.701275 1013 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:45.703823 1172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.705307 1013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:45.705447 1013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "1ded8b07f419469788803f6960172b07"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "ff02769591b83d03ef39850eeac4f47a"
server_key_iv: "cb4173d1a6c761876c66364c7db56749"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.706148 1013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:45.732062 1013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:45.735783 1013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:45.735996 1013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:45.736817 1013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:45.738029 1013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:45.738101 1013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.738174 1013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:45.738201 1013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.750267 1013 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:39089
I20260810 06:30:45.750314 1358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:39089 every 8 connection(s)
I20260810 06:30:45.751523 1013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:45.758716 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 1013
I20260810 06:30:45.758939 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 32546
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.252@KRBTEST.COM
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.253@KRBTEST.COM
I20260810 06:30:45.773779 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.753911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:33341 (local address 127.21.195.253:37987)
0810 06:30:45.754072 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.754075 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.755557 (+ 1482us) server_negotiation.cc:407] Connection header received
0810 06:30:45.756699 (+ 1142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.756703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.756770 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.756851 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.758643 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.759480 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.761743 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.762116 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.762199 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.767647 (+ 5448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.767652 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.767655 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.767688 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.769886 (+ 2198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.771196 (+ 1310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.771200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.771202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.771304 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.772732 (+ 1428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.772736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.772738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.772988 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.773079 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.773403 (+ 324us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.773600 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260810 06:30:45.775451 1367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.754369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.21.195.193:33341)
0810 06:30:45.755304 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.755372 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.756429 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.757078 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.757087 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.757745 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.758439 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.758464 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.759664 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.759667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.761580 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.761594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.762439 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.762444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.762733 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.763474 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.763499 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.767490 (+ 3991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.770313 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.770316 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.770317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.770541 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.771415 (+ 874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.771417 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.771419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.771518 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.773140 (+ 1622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.773143 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.773234 (+ 91us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.773968 (+ 734us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.774375 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"mutex_wait_us":301,"spinlock_wait_cycles":58624,"thread_start_us":149,"threads_started":1}
I20260810 06:30:45.776252 1366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.753775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:41257 (local address 127.21.195.252:45361)
0810 06:30:45.754205 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.754208 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.755499 (+ 1291us) server_negotiation.cc:407] Connection header received
0810 06:30:45.756717 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.756721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.756787 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.756850 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.758642 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.759704 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.761740 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.762116 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.762200 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.766506 (+ 4306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.766511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.766514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.766549 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.768600 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.770650 (+ 2050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.770654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.770655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.770760 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.771633 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.771636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.771638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.771895 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.771982 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.775968 (+ 3986us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.776121 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":126,"threads_started":1}
I20260810 06:30:45.776777 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.754369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.21.195.193:41257)
0810 06:30:45.755304 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.755372 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.756429 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.757115 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.757118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.757743 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.758439 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.758464 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.759897 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.759900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.761593 (+ 1693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.761600 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.762439 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.762444 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.762734 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.763694 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.763709 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.766297 (+ 2588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.769063 (+ 2766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.769066 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.769068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.770226 (+ 1158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.770874 (+ 648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.770877 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.770879 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.771069 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.772055 (+ 986us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.772062 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.772455 (+ 393us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.776453 (+ 3998us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.776627 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"mutex_wait_us":313,"spinlock_wait_cycles":99840,"thread_start_us":295,"threads_started":1}
I20260810 06:30:45.785604 1360 heartbeater.cc:347] Connected to a master server at 127.21.195.252:45361
I20260810 06:30:45.785943 1360 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:45.786610 1360 heartbeater.cc:511] Master 127.21.195.252:45361 requested a full tablet report, sending...
I20260810 06:30:45.788508 1074 ts_manager.cc:194] Registered new tserver with Master: 1ded8b07f419469788803f6960172b07 (127.21.195.193:39089)
I20260810 06:30:45.791568 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.756013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:41715 (local address 127.21.195.254:44679)
0810 06:30:45.756171 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:45.756175 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:45.756189 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:30:45.756702 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:45.756705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:45.756772 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:45.756828 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:45.758637 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.759474 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.761793 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.762215 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.762309 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.766070 (+ 3761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:45.766075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:45.766079 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:45.766117 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:45.768653 (+ 2536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.789686 (+ 21033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.789692 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.789695 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.789878 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:45.790342 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:45.790347 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:45.790349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:45.790686 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:45.790799 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:45.791226 (+ 427us) server_negotiation.cc:299] Negotiation successful
0810 06:30:45.791399 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 06:30:45.792120 1372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:45.755608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.193:41715)
0810 06:30:45.755961 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:45.755975 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:45.756431 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:45.757076 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:45.757084 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:45.757717 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:45.758441 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.758464 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.759719 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.759723 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.761602 (+ 1879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:45.761616 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:45.762570 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:45.762577 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:45.762786 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:45.763609 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:45.763626 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:45.765848 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:45.768837 (+ 2989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.768846 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.768872 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.789470 (+ 20598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.790057 (+ 587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:45.790061 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:45.790063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:45.790195 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:45.790872 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:45.790876 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:45.791006 (+ 130us) client_negotiation.cc:769] Sending connection context
0810 06:30:45.791808 (+ 802us) client_negotiation.cc:240] Negotiation successful
0810 06:30:45.791973 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":200,"spinlock_wait_cycles":35968,"thread_start_us":84,"threads_started":1}
I20260810 06:30:45.792923 536 heartbeater.cc:503] Master 127.21.195.254:44679 was elected leader, sending a full tablet report...
I20260810 06:30:45.794373 1359 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44679
I20260810 06:30:45.794477 1359 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:45.794494 1362 heartbeater.cc:347] Connected to a master server at 127.21.195.253:37987
I20260810 06:30:45.794591 1362 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:45.794660 1359 heartbeater.cc:511] Master 127.21.195.254:44679 requested a full tablet report, sending...
I20260810 06:30:45.794762 1362 heartbeater.cc:511] Master 127.21.195.253:37987 requested a full tablet report, sending...
I20260810 06:30:45.795545 32229 ts_manager.cc:194] Re-registered known tserver with Master: 1ded8b07f419469788803f6960172b07 (127.21.195.193:39089)
I20260810 06:30:45.796121 777 ts_manager.cc:194] Registered new tserver with Master: 1ded8b07f419469788803f6960172b07 (127.21.195.193:39089)
I20260810 06:30:45.796331 32229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:41715
I20260810 06:30:45.798663 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:35697
--local_ip_for_outbound_sockets=127.21.195.194
--tserver_master_addrs=127.21.195.254:44679
--webserver_port=43367
--webserver_interface=127.21.195.194
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab
--principal=oryx/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987,127.21.195.252:45361 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:45.925884 1373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:45.926213 1373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:45.926283 1373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:45.930613 1373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:45.930704 1373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:45.930795 1373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:45.936628 1373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab
--principal=oryx/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:35697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=43367
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987,127.21.195.252:45361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:45.938022 1373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:45.939252 1373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:45.950254 1385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:45.950248 1381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:45.950338 1373 server_base.cc:1034] running on GCE node
W20260810 06:30:45.950248 1380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:45.951052 1373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:45.951787 1373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:45.952962 1373 hybrid_clock.cc:648] HybridClock initialized: now 1786343445952934 us; error 41 us; skew 500 ppm
Aug 10 06:30:45 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:45.956005 1373 init.cc:377] Logged in from keytab as oryx/127.21.195.194@KRBTEST.COM (short username oryx)
I20260810 06:30:45.957022 1373 webserver.cc:460] Webserver started at http://127.21.195.194:43367/ using document root <none> and password file <none>
I20260810 06:30:45.957684 1373 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:45.957778 1373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:45.962384 1373 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:30:45.965068 1396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.966811 1373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:30:45.966955 1373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "061f017a96d740a191b5ffd328739270"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "4362fc13d9ff54269c0df92848f215c8"
server_key_iv: "47cf96bb5e49483e2658efaa94238cc0"
server_key_version: "encryptionkey@0"
I20260810 06:30:45.967640 1373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:45.985423 1373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:45.989092 1373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:45.989296 1373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:45.990093 1373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:45.991155 1373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:45.991212 1373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:45.991257 1373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:45.991271 1373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:46.001293 1373 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:35697
I20260810 06:30:46.001341 1582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:35697 every 8 connection(s)
I20260810 06:30:46.002563 1373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:46.006644 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 1373
I20260810 06:30:46.006870 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 320
Aug 10 06:30:46 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.253@KRBTEST.COM
Aug 10 06:30:46 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.252@KRBTEST.COM
I20260810 06:30:46.023898 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.004718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:33459 (local address 127.21.195.253:37987)
0810 06:30:46.004898 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.004904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.006313 (+ 1409us) server_negotiation.cc:407] Connection header received
0810 06:30:46.007706 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.007712 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.007785 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.007852 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.010430 (+ 2578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.011278 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.013210 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.013624 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.013709 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.018234 (+ 4525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.018239 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.018242 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.018278 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.020087 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.021643 (+ 1556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.021646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.021648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.021752 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.022264 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.022268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.022270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.022536 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.022610 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.023553 (+ 943us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.023715 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260810 06:30:46.023898 1366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.004763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:52323 (local address 127.21.195.252:45361)
0810 06:30:46.004901 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.004906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.006315 (+ 1409us) server_negotiation.cc:407] Connection header received
0810 06:30:46.010050 (+ 3735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.010054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.010121 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.010204 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.010890 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.011632 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.013224 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.013621 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.013709 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.018234 (+ 4525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.018239 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.018242 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.018278 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.020663 (+ 2385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.021641 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.021645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.021647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.021752 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.022265 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.022268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.022270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.022524 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.022611 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.023552 (+ 941us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.023715 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:46.025998 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.005203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.21.195.194:52323)
0810 06:30:46.006120 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.006180 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.007297 (+ 1117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.010320 (+ 3023us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.010323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.010589 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:46.010726 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.010734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.011819 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.011822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.013044 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.013057 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.013960 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.013964 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.014284 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.015135 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:46.015171 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:46.017963 (+ 2792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:46.020807 (+ 2844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.020816 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.020839 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.021475 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.021867 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.021871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.021873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.022142 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.022689 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:46.022697 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:46.023205 (+ 508us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.024643 (+ 1438us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.024776 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"mutex_wait_us":149,"spinlock_wait_cycles":88448,"thread_start_us":216,"threads_started":1}
I20260810 06:30:46.025998 1591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.005203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.21.195.194:33459)
0810 06:30:46.006120 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.006181 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.007553 (+ 1372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.008419 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.008431 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.009163 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:46.010246 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.010272 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.011521 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.011524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.013063 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.013070 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.013960 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.014029 (+ 69us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.014289 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.015152 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:46.015165 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:46.017963 (+ 2798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:46.020825 (+ 2862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.020828 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.020838 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.021482 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.021867 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.021871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.021873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.022142 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.022689 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:46.022697 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:46.023205 (+ 508us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.024193 (+ 988us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.024658 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":118,"spinlock_wait_cycles":39552,"thread_start_us":241,"threads_started":1}
Aug 10 06:30:46 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343445, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:46.035517 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.006905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:41695 (local address 127.21.195.254:44679)
0810 06:30:46.007127 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.007134 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.026842 (+ 19708us) server_negotiation.cc:407] Connection header received
0810 06:30:46.027081 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.027085 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.027145 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.027218 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.027780 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.028403 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.029232 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.029472 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.029614 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.031753 (+ 2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.031756 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.031758 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.031789 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.033322 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.033885 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.033889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.033891 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.034000 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.034311 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.034314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.034316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.034568 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.034644 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.035117 (+ 473us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.035335 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260810 06:30:46.035861 1587 heartbeater.cc:347] Connected to a master server at 127.21.195.253:37987
I20260810 06:30:46.036139 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.006460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.194:41695)
0810 06:30:46.026755 (+ 20295us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.026772 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.026939 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.027255 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.027258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.027471 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:46.027608 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.027614 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.028529 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.028532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.029100 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.029108 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.029613 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.029617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.029730 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.030226 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:46.030241 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:46.031582 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:46.033437 (+ 1855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.033441 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.033443 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.033730 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.034108 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.034111 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.034114 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.034206 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.034717 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:46.034719 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:46.034822 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.035739 (+ 917us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.035905 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20216,"thread_start_us":106,"threads_started":1}
I20260810 06:30:46.036170 1587 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:46.036842 1584 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44679
I20260810 06:30:46.036886 1587 heartbeater.cc:511] Master 127.21.195.253:37987 requested a full tablet report, sending...
I20260810 06:30:46.036958 1584 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:46.037137 1584 heartbeater.cc:511] Master 127.21.195.254:44679 requested a full tablet report, sending...
I20260810 06:30:46.035861 1585 heartbeater.cc:347] Connected to a master server at 127.21.195.252:45361
I20260810 06:30:46.037470 1585 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:46.037660 1585 heartbeater.cc:511] Master 127.21.195.252:45361 requested a full tablet report, sending...
I20260810 06:30:46.038255 32229 ts_manager.cc:194] Re-registered known tserver with Master: 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697)
I20260810 06:30:46.038340 777 ts_manager.cc:194] Registered new tserver with Master: 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697)
I20260810 06:30:46.038666 1074 ts_manager.cc:194] Registered new tserver with Master: 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697)
I20260810 06:30:46.039029 32229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:41695
I20260810 06:30:46.043210 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:44199
--local_ip_for_outbound_sockets=127.21.195.195
--tserver_master_addrs=127.21.195.254:44679
--webserver_port=32981
--webserver_interface=127.21.195.195
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab
--principal=oryx/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987,127.21.195.252:45361 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:30:46.052974 1366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.049568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57638 (local address 127.21.195.252:45361)
0810 06:30:46.049693 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.049698 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.049717 (+ 19us) server_negotiation.cc:407] Connection header received
0810 06:30:46.049900 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.049903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.049969 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.050058 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:46.050328 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.050888 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.051913 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.052383 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.052522 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.052724 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.052763 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.052835 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 06:30:46.052974 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.049455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.0.0.1:57638)
0810 06:30:46.049651 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.049668 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.049786 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.050086 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.050089 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.050111 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:46.050216 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.050221 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.051011 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.051015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.051777 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.051787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.052522 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.052527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.052625 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.052649 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.052710 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.052811 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260810 06:30:46.053882 1093 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 06:30:46.054352 1140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b11382a7a35f4ccfbd1cd73ef150e1df. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:46.054512 1140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: This master's current role is: LEARNER
W20260810 06:30:46.168120 1596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:46.168467 1596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:46.168534 1596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:46.173043 1596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:46.173134 1596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:46.173224 1596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:46.179317 1596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab
--principal=oryx/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:44199
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=32981
--tserver_master_addrs=127.21.195.254:44679,127.21.195.253:37987,127.21.195.252:45361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:46.180653 1596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:46.181876 1596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:46.193054 1610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:46.193058 1605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:46.193176 1596 server_base.cc:1034] running on GCE node
W20260810 06:30:46.193449 1606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:46.193953 1596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:46.194651 1596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:46.195817 1596 hybrid_clock.cc:648] HybridClock initialized: now 1786343446195790 us; error 40 us; skew 500 ppm
Aug 10 06:30:46 dist-test-slave-7lbf krb5kdc[32156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343446, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:46.198911 1596 init.cc:377] Logged in from keytab as oryx/127.21.195.195@KRBTEST.COM (short username oryx)
I20260810 06:30:46.199968 1596 webserver.cc:460] Webserver started at http://127.21.195.195:32981/ using document root <none> and password file <none>
I20260810 06:30:46.200625 1596 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:46.200729 1596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:46.205309 1596 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:46.207849 1618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:46.209368 1596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:46.209547 1596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "496083a81d6246a585fc3c85be0c6d39"
format_stamp: "Formatted at 2026-08-10 06:30:44 on dist-test-slave-7lbf"
server_key: "28ad3e3bfe20b9d0fb71117ad442ffae"
server_key_iv: "6b91b07a96598266b662f7e5803f0ef0"
server_key_version: "encryptionkey@0"
I20260810 06:30:46.210278 1596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:46.234917 1596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:46.238485 1596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:46.238709 1596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:46.239459 1596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:46.240494 1596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:46.240552 1596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:46.240617 1596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:46.240644 1596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:46.250144 1596 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:44199
I20260810 06:30:46.250190 1800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:44199 every 8 connection(s)
I20260810 06:30:46.251428 1596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:46.261561 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 1596
Aug 10 06:30:46 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343446, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.253@KRBTEST.COM
Aug 10 06:30:46 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343446, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
Aug 10 06:30:46 dist-test-slave-7lbf krb5kdc[32156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343446, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.252@KRBTEST.COM
I20260810 06:30:46.269706 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.253470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:60989 (local address 127.21.195.253:37987)
0810 06:30:46.253668 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.253673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.255067 (+ 1394us) server_negotiation.cc:407] Connection header received
0810 06:30:46.256187 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.256190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.256254 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.256328 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.257964 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.258805 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.260086 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.260392 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.260501 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.264825 (+ 4324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.264830 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.264833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.264866 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.266884 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.267653 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.267657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.267659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.267761 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.268204 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.268208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.268210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.268456 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.268535 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.269332 (+ 797us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.269476 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 06:30:46.272094 1811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.254000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.21.195.195:60989)
0810 06:30:46.254936 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.254951 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.255957 (+ 1006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.256522 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.256530 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.257132 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:46.257811 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.257827 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.258932 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.258936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.259949 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.259960 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.260507 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.260511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.260605 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.261322 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:46.261339 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:46.264572 (+ 3233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:46.267014 (+ 2442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.267021 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.267043 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.267542 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.267869 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.267872 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.267874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.268093 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.268622 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:46.268629 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:46.269019 (+ 390us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.270174 (+ 1155us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.270625 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":101,"spinlock_wait_cycles":53376,"thread_start_us":152,"threads_started":1}
I20260810 06:30:46.272802 1812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.255039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.195:40175)
0810 06:30:46.255356 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.255368 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.255967 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.256523 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.256531 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.257133 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:46.257813 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.257830 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.258971 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.258974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.259759 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.259768 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.260333 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.260337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.260543 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.261260 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:46.261283 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:46.265303 (+ 4020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:46.270158 (+ 4855us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.270161 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.270163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.270420 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.270858 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.270862 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.270863 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.270957 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.271528 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:46.271532 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:46.271640 (+ 108us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.271748 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.271904 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":100,"spinlock_wait_cycles":11008,"thread_start_us":78,"threads_started":1}
I20260810 06:30:46.273582 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.255184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:40175 (local address 127.21.195.254:44679)
0810 06:30:46.255313 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.255317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.255455 (+ 138us) server_negotiation.cc:407] Connection header received
0810 06:30:46.256201 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.256205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.256258 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.256311 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.258033 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.258818 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.259894 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.260179 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.260288 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.265489 (+ 5201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.265494 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.265497 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.265555 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.269923 (+ 4368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.270639 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.270643 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.270645 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.270754 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.271095 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.271099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.271101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.271374 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.271475 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.273235 (+ 1760us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.273373 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:30:46.274484 1801 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44679
I20260810 06:30:46.274679 1806 heartbeater.cc:347] Connected to a master server at 127.21.195.253:37987
I20260810 06:30:46.274799 1801 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:46.275527 1801 heartbeater.cc:511] Master 127.21.195.254:44679 requested a full tablet report, sending...
I20260810 06:30:46.276026 1829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.264850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51600 (local address 127.21.195.253:37987)
0810 06:30:46.266173 (+ 1323us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.266177 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.266457 (+ 280us) server_negotiation.cc:407] Connection header received
0810 06:30:46.266554 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.266557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.266606 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.266687 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.267646 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.268370 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.269489 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.269838 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.269939 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.271509 (+ 1570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.271513 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.271515 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.271540 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.273648 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.274120 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.274124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.274126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.274213 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.274520 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.274524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.274525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.274911 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.275056 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.275726 (+ 670us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.275858 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1205,"thread_start_us":103,"threads_started":1}
I20260810 06:30:46.276068 1366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.253771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:41359 (local address 127.21.195.252:45361)
0810 06:30:46.253929 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.253940 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.255051 (+ 1111us) server_negotiation.cc:407] Connection header received
0810 06:30:46.256198 (+ 1147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.256202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.256259 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.256311 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.257996 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.258532 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.260169 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.260480 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.260581 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.264922 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.264927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.264929 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.264960 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.268807 (+ 3847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.274680 (+ 5873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.274684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.274686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.274791 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.275131 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.275135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.275136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.275359 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.275443 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.275782 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.275912 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 06:30:46.276525 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.254000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.21.195.195:41359)
0810 06:30:46.254878 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.254950 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.255962 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.256523 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.256531 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.257137 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:46.257813 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.257830 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.258689 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.258691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.260063 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.260072 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.260670 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.260674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.260753 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.261420 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:46.261431 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:46.264751 (+ 3320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:46.274324 (+ 9573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.274327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.274329 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.274575 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.274910 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:46.274913 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:46.274914 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:46.275018 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:46.275502 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:46.275505 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:46.275594 (+ 89us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.276194 (+ 600us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.276355 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":124,"spinlock_wait_cycles":21632,"thread_start_us":124,"threads_started":1}
I20260810 06:30:46.276899 32229 ts_manager.cc:194] Re-registered known tserver with Master: 496083a81d6246a585fc3c85be0c6d39 (127.21.195.195:44199)
I20260810 06:30:46.277665 32229 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:40175
I20260810 06:30:46.274801 1806 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:46.278223 1805 heartbeater.cc:347] Connected to a master server at 127.21.195.252:45361
I20260810 06:30:46.278313 1805 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:46.278419 1806 heartbeater.cc:511] Master 127.21.195.253:37987 requested a full tablet report, sending...
I20260810 06:30:46.278437 1805 heartbeater.cc:511] Master 127.21.195.252:45361 requested a full tablet report, sending...
I20260810 06:30:46.279263 1074 ts_manager.cc:194] Registered new tserver with Master: 496083a81d6246a585fc3c85be0c6d39 (127.21.195.195:44199)
I20260810 06:30:46.280534 777 ts_manager.cc:194] Registered new tserver with Master: 496083a81d6246a585fc3c85be0c6d39 (127.21.195.195:44199)
I20260810 06:30:46.280599 1823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.263689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57646 (local address 127.21.195.252:45361)
0810 06:30:46.264058 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.264064 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.264506 (+ 442us) server_negotiation.cc:407] Connection header received
0810 06:30:46.264558 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.264562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.264619 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.264708 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.265769 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.266608 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.267864 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.268254 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.268341 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.270124 (+ 1783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.270128 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.270130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.270161 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.273011 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.279232 (+ 6221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.279236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.279238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.279353 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.279682 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.279685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.279687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.279915 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.280053 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.280280 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.280415 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":107,"threads_started":1}
I20260810 06:30:46.282802 1828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.264605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52030 (local address 127.21.195.254:44679)
0810 06:30:46.265695 (+ 1090us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.265700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.265715 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:46.265810 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.265813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.265867 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.265976 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.274321 (+ 8345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.275532 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.276924 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.277258 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.277360 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.279538 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.279542 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.279545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.279575 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.281392 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.281815 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.281818 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.281819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.281907 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.282110 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.282112 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.282114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.282299 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.282408 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.282561 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.282673 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1002,"thread_start_us":89,"threads_started":1}
I20260810 06:30:46.285758 32229 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:46.288926 32229 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:46.291996 1016 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: NON_VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: true } } }
I20260810 06:30:46.292158 1016 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:46.296218 1831 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: attempting to promote NON_VOTER 65ba81615c5042ecb443658951d971c6 to VOTER
I20260810 06:30:46.296629 1831 consensus_queue.cc:237] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } }
I20260810 06:30:46.298481 789 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Refusing update from remote peer b11382a7a35f4ccfbd1cd73ef150e1df: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 06:30:46.298627 1093 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 LEARNER]: Refusing update from remote peer b11382a7a35f4ccfbd1cd73ef150e1df: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 06:30:46.299080 1833 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 06:30:46.299309 1016 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 06:30:46.301017 1016 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 65ba81615c5042ecb443658951d971c6 (127.21.195.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:46.301668 789 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 65ba81615c5042ecb443658951d971c6 (127.21.195.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:46.301973 1093 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 65ba81615c5042ecb443658951d971c6 (127.21.195.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:46.302608 1016 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:46.302707 1016 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:46.302583 1833 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:46.302915 1833 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:46.302835 1832 sys_catalog.cc:455] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:46.303037 1832 sys_catalog.cc:458] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:46.303815 1848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:46.303957 1848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:30:46.305191 1140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:46.305312 1140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:30:46.312755 1850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.306445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39089 (local address 127.0.0.1:41442)
0810 06:30:46.308184 (+ 1739us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.308197 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.308389 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.308875 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.308878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.308898 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:46.309024 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.309031 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.310297 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.310301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.311321 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.311330 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.312323 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.312327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.312416 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.312449 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.312512 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.312590 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1684,"thread_start_us":132,"threads_started":1}
I20260810 06:30:46.312757 1853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.307375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41442 (local address 127.21.195.193:39089)
0810 06:30:46.307836 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.307844 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.308387 (+ 543us) server_negotiation.cc:407] Connection header received
0810 06:30:46.308520 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.308526 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.308738 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.308900 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:46.309119 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.310201 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.311459 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.312202 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.312324 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.312491 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.312549 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.312644 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":127,"threads_started":1}
I20260810 06:30:46.313807 1851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.306807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:35697 (local address 127.0.0.1:51102)
0810 06:30:46.308631 (+ 1824us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.308641 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.308751 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.309266 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.309268 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.309287 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:46.309377 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.309383 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.310849 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.310853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.312057 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.312068 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.313362 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.313366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.313453 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.313478 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.313564 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.313641 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1768,"thread_start_us":96,"threads_started":1}
I20260810 06:30:46.313867 1852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.307011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51102 (local address 127.21.195.194:35697)
0810 06:30:46.308047 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.308056 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.308762 (+ 706us) server_negotiation.cc:407] Connection header received
0810 06:30:46.308861 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.308866 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.309120 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.309297 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:46.309479 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.310707 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.312201 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.313233 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.313389 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.313565 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.313623 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.313715 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":930,"thread_start_us":117,"threads_started":1}
I20260810 06:30:46.314515 1849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.306419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45166 (local address 127.21.195.195:44199)
0810 06:30:46.309083 (+ 2664us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.309131 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.309158 (+ 27us) server_negotiation.cc:407] Connection header received
0810 06:30:46.309244 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.309249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.309448 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.309692 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:46.309906 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.311083 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.312439 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.313279 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.314080 (+ 801us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.314215 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.314259 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.314336 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2546,"thread_start_us":144,"threads_started":1}
I20260810 06:30:46.316640 1249 tablet_service.cc:1467] Processing CreateTablet for tablet fd776e936cb4499eb3e6a6bc32b5e7b6 (DEFAULT_TABLE table=test-table [id=93c87425a0ed45b38cd2fd919e1c25cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:46.313848 705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.306234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:44199 (local address 127.0.0.1:45166)
0810 06:30:46.306696 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.306713 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.306805 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.309663 (+ 2858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.309667 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.309685 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:46.309758 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.309763 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.311208 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.311212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.312280 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.312288 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.313404 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.313408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.313509 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.313553 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.313608 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.313681 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":1}
I20260810 06:30:46.317890 1249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd776e936cb4499eb3e6a6bc32b5e7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:46.321269 1692 tablet_service.cc:1467] Processing CreateTablet for tablet fd776e936cb4499eb3e6a6bc32b5e7b6 (DEFAULT_TABLE table=test-table [id=93c87425a0ed45b38cd2fd919e1c25cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:46.321882 1486 tablet_service.cc:1467] Processing CreateTablet for tablet fd776e936cb4499eb3e6a6bc32b5e7b6 (DEFAULT_TABLE table=test-table [id=93c87425a0ed45b38cd2fd919e1c25cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:46.322613 1692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd776e936cb4499eb3e6a6bc32b5e7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:46.323057 1486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd776e936cb4499eb3e6a6bc32b5e7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:46.327138 1854 tablet_bootstrap.cc:492] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: Bootstrap starting.
I20260810 06:30:46.329399 1854 tablet_bootstrap.cc:654] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:46.330209 1854 log.cc:824] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:46.332166 1857 tablet_bootstrap.cc:492] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: Bootstrap starting.
I20260810 06:30:46.332458 1854 tablet_bootstrap.cc:492] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: No bootstrap required, opened a new log
I20260810 06:30:46.332710 1854 ts_tablet_manager.cc:1397] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:30:46.332892 1856 tablet_bootstrap.cc:492] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: Bootstrap starting.
I20260810 06:30:46.336004 1856 tablet_bootstrap.cc:654] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:46.337052 1854 raft_consensus.cc:348] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.337409 1854 raft_consensus.cc:374] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:46.337383 1856 log.cc:824] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:46.337495 1854 raft_consensus.cc:729] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ded8b07f419469788803f6960172b07, State: Initialized, Role: FOLLOWER
I20260810 06:30:46.338078 1854 consensus_queue.cc:260] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.339231 1854 ts_tablet_manager.cc:1428] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 06:30:46.339701 1359 heartbeater.cc:503] Master 127.21.195.254:44679 was elected leader, sending a full tablet report...
I20260810 06:30:46.340119 1856 tablet_bootstrap.cc:492] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: No bootstrap required, opened a new log
I20260810 06:30:46.340268 1857 tablet_bootstrap.cc:654] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:46.340337 1856 ts_tablet_manager.cc:1397] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 06:30:46.343719 1857 log.cc:824] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:46.346772 1856 raft_consensus.cc:348] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.347075 1856 raft_consensus.cc:374] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:46.347146 1856 raft_consensus.cc:729] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 496083a81d6246a585fc3c85be0c6d39, State: Initialized, Role: FOLLOWER
I20260810 06:30:46.347612 1856 consensus_queue.cc:260] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.347719 1857 tablet_bootstrap.cc:492] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: No bootstrap required, opened a new log
I20260810 06:30:46.347939 1857 ts_tablet_manager.cc:1397] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260810 06:30:46.348433 1801 heartbeater.cc:503] Master 127.21.195.254:44679 was elected leader, sending a full tablet report...
I20260810 06:30:46.349957 1856 ts_tablet_manager.cc:1428] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260810 06:30:46.353044 1857 raft_consensus.cc:348] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.353397 1857 raft_consensus.cc:374] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:46.353468 1857 raft_consensus.cc:729] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061f017a96d740a191b5ffd328739270, State: Initialized, Role: FOLLOWER
I20260810 06:30:46.353995 1857 consensus_queue.cc:260] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.354830 1584 heartbeater.cc:503] Master 127.21.195.254:44679 was elected leader, sending a full tablet report...
I20260810 06:30:46.355695 1857 ts_tablet_manager.cc:1428] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: Time spent starting tablet: real 0.008s user 0.002s sys 0.007s
I20260810 06:30:46.432433 1863 raft_consensus.cc:482] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:46.432703 1863 raft_consensus.cc:504] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.434077 1863 leader_election.cc:288] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ded8b07f419469788803f6960172b07 (127.21.195.193:39089), 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697)
I20260810 06:30:46.438258 1811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.434750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:35697 (local address 127.21.195.195:41657)
0810 06:30:46.434944 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.434957 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.435064 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.435399 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.435402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.435429 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:46.435546 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.435552 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.436348 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.436352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.437132 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.437141 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.437812 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.437815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.437923 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.437943 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.438009 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.438090 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"spinlock_wait_cycles":3456}
I20260810 06:30:46.438251 1852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.434837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:41657 (local address 127.21.195.194:35697)
0810 06:30:46.434960 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.434964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.435189 (+ 225us) server_negotiation.cc:407] Connection header received
0810 06:30:46.435248 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.435250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.435293 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.435356 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:46.435650 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.436237 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.437260 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.437696 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.437805 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.437860 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.438038 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.438117 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:30:46.438295 1853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.434450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:43519 (local address 127.21.195.193:39089)
0810 06:30:46.434597 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.434601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.434619 (+ 18us) server_negotiation.cc:407] Connection header received
0810 06:30:46.434847 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.434850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.434908 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.435011 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:46.435434 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.436025 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.437159 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.437620 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.437737 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.437799 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.438106 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.438192 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 06:30:46.438295 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.434400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39089 (local address 127.21.195.195:43519)
0810 06:30:46.434548 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:46.434564 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:46.434701 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:46.435030 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:46.435033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:46.435066 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:46.435302 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.435310 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.436143 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.436146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.437016 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:46.437027 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.437738 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.437741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:46.437973 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.437995 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 06:30:46.438067 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:30:46.438146 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"spinlock_wait_cycles":2688}
I20260810 06:30:46.439281 1281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd776e936cb4499eb3e6a6bc32b5e7b6" candidate_uuid: "496083a81d6246a585fc3c85be0c6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ded8b07f419469788803f6960172b07" is_pre_election: true
I20260810 06:30:46.439340 1516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd776e936cb4499eb3e6a6bc32b5e7b6" candidate_uuid: "496083a81d6246a585fc3c85be0c6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "061f017a96d740a191b5ffd328739270" is_pre_election: true
I20260810 06:30:46.439672 1281 raft_consensus.cc:2454] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 496083a81d6246a585fc3c85be0c6d39 in term 0.
I20260810 06:30:46.439698 1516 raft_consensus.cc:2454] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 496083a81d6246a585fc3c85be0c6d39 in term 0.
I20260810 06:30:46.440189 1622 leader_election.cc:302] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061f017a96d740a191b5ffd328739270, 496083a81d6246a585fc3c85be0c6d39; no voters:
I20260810 06:30:46.440510 1863 raft_consensus.cc:2781] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:46.440600 1863 raft_consensus.cc:482] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:46.440631 1863 raft_consensus.cc:3037] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:46.441856 1863 raft_consensus.cc:504] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.442242 1863 leader_election.cc:288] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [CANDIDATE]: Term 1 election: Requested vote from peers 1ded8b07f419469788803f6960172b07 (127.21.195.193:39089), 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697)
I20260810 06:30:46.442788 1516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd776e936cb4499eb3e6a6bc32b5e7b6" candidate_uuid: "496083a81d6246a585fc3c85be0c6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "061f017a96d740a191b5ffd328739270"
I20260810 06:30:46.442866 1281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd776e936cb4499eb3e6a6bc32b5e7b6" candidate_uuid: "496083a81d6246a585fc3c85be0c6d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ded8b07f419469788803f6960172b07"
I20260810 06:30:46.442929 1516 raft_consensus.cc:3037] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:46.443005 1281 raft_consensus.cc:3037] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:46.444118 1516 raft_consensus.cc:2454] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 496083a81d6246a585fc3c85be0c6d39 in term 1.
I20260810 06:30:46.444253 1281 raft_consensus.cc:2454] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 496083a81d6246a585fc3c85be0c6d39 in term 1.
I20260810 06:30:46.444447 1622 leader_election.cc:302] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061f017a96d740a191b5ffd328739270, 496083a81d6246a585fc3c85be0c6d39; no voters:
I20260810 06:30:46.444623 1863 raft_consensus.cc:2781] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:46.444892 1863 raft_consensus.cc:686] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 1 LEADER]: Becoming Leader. State: Replica: 496083a81d6246a585fc3c85be0c6d39, State: Running, Role: LEADER
I20260810 06:30:46.445290 1863 consensus_queue.cc:237] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } }
I20260810 06:30:46.449048 32229 catalog_manager.cc:5495] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 496083a81d6246a585fc3c85be0c6d39 (127.21.195.195). New cstate: current_term: 1 leader_uuid: "496083a81d6246a585fc3c85be0c6d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } health_report { overall_health: UNKNOWN } } }
I20260810 06:30:46.467033 1849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.462694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45172 (local address 127.21.195.195:44199)
0810 06:30:46.462839 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.462843 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.462859 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:30:46.463032 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.463034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.463099 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.463213 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:46.463472 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.464149 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.465210 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.465449 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.465569 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.465918 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:46.466472 (+ 554us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:46.466594 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.466676 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.466747 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:30:46.474074 1281 raft_consensus.cc:1261] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 1 FOLLOWER]: Refusing update from remote peer 496083a81d6246a585fc3c85be0c6d39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:46.474073 1516 raft_consensus.cc:1261] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 1 FOLLOWER]: Refusing update from remote peer 496083a81d6246a585fc3c85be0c6d39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:46.475131 1866 consensus_queue.cc:1035] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:46.475360 1863 consensus_queue.cc:1035] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:46.487857 1880 mvcc.cc:205] Tried to move back new op lower bound from 7316862756749086720 to 7316862756642996224. Current Snapshot: MvccSnapshot[applied={T|T < 7316862756749086720}]
I20260810 06:30:46.491614 1877 mvcc.cc:205] Tried to move back new op lower bound from 7316862756749086720 to 7316862756642996224. Current Snapshot: MvccSnapshot[applied={T|T < 7316862756749086720}]
I20260810 06:30:46.498119 32228 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:46.498314 32228 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:46.504588 32228 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b11382a7a35f4ccfbd1cd73ef150e1df: Sending DeleteTablet for 3 replicas of tablet fd776e936cb4499eb3e6a6bc32b5e7b6
I20260810 06:30:46.505653 1692 tablet_service.cc:1514] Processing DeleteTablet for tablet fd776e936cb4499eb3e6a6bc32b5e7b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:46 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:45166
I20260810 06:30:46.505707 1486 tablet_service.cc:1514] Processing DeleteTablet for tablet fd776e936cb4499eb3e6a6bc32b5e7b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:46 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:51102
I20260810 06:30:46.505853 1249 tablet_service.cc:1514] Processing DeleteTablet for tablet fd776e936cb4499eb3e6a6bc32b5e7b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:46 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:41442
I20260810 06:30:46.506589 1894 tablet_replica.cc:330] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: stopping tablet replica
I20260810 06:30:46.507011 1894 raft_consensus.cc:2229] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:46.507424 1894 raft_consensus.cc:2258] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:46.507956 1891 tablet_replica.cc:330] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: stopping tablet replica
I20260810 06:30:46.508337 1891 raft_consensus.cc:2229] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:46.508751 1891 raft_consensus.cc:2258] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:46.509837 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 32172
I20260810 06:30:46.524823 1894 ts_tablet_manager.cc:1905] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:46.529088 1894 ts_tablet_manager.cc:1918] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:46.529242 1894 log.cc:1196] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/fd776e936cb4499eb3e6a6bc32b5e7b6
I20260810 06:30:46.529650 1894 ts_tablet_manager.cc:1939] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 061f017a96d740a191b5ffd328739270: Deleting consensus metadata
I20260810 06:30:46.534124 1895 tablet_replica.cc:330] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: stopping tablet replica
I20260810 06:30:46.534569 1895 raft_consensus.cc:2229] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:46.535121 1895 raft_consensus.cc:2258] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:46.537106 1895 ts_tablet_manager.cc:1905] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 06:30:46.537309 1397 connection.cc:535] server connection from 127.0.0.1:51102 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 06:30:46.538333 1891 ts_tablet_manager.cc:1905] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:46.540411 1895 ts_tablet_manager.cc:1918] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:46.540524 1895 log.cc:1196] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/fd776e936cb4499eb3e6a6bc32b5e7b6
I20260810 06:30:46.540908 1895 ts_tablet_manager.cc:1939] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 1ded8b07f419469788803f6960172b07: Deleting consensus metadata
W20260810 06:30:46.542352 1176 connection.cc:441] server connection from 127.0.0.1:41442 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41442 (request call id 1) could send its response
I20260810 06:30:46.548120 1891 ts_tablet_manager.cc:1918] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:46.548962 1829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.508082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51608 (local address 127.21.195.253:37987)
0810 06:30:46.508203 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.508207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.508222 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:46.508264 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.508267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.508320 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.508420 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.523610 (+ 15190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.524525 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.526126 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.526533 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.526624 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.538670 (+ 12046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.538676 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.538679 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.538725 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.540729 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.542624 (+ 1895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.542630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.542632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.542779 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.543192 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.543196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.543199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.543483 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.543619 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.548610 (+ 4991us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.548782 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:30:46.551918 1891 log.cc:1196] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/fd776e936cb4499eb3e6a6bc32b5e7b6
I20260810 06:30:46.552496 1891 ts_tablet_manager.cc:1939] T fd776e936cb4499eb3e6a6bc32b5e7b6 P 496083a81d6246a585fc3c85be0c6d39: Deleting consensus metadata
W20260810 06:30:46.554018 1619 connection.cc:441] server connection from 127.0.0.1:45166 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45166 (request call id 1) could send its response
I20260810 06:30:46.557260 1366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.543556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57674 (local address 127.21.195.252:45361)
0810 06:30:46.543909 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.543915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.545287 (+ 1372us) server_negotiation.cc:407] Connection header received
0810 06:30:46.545958 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.545966 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.546055 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.546136 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.547942 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.548823 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.550022 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.550343 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.550433 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.552888 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.552893 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.552896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.552931 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.554986 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.555533 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.555538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.555539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.555652 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.556068 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.556072 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.556075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.556345 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.556475 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.556912 (+ 437us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.557064 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260810 06:30:46.558990 973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.544103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.21.195.253:37987)
0810 06:30:46.544276 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.544281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.544789 (+ 508us) server_negotiation.cc:407] Connection header received
0810 06:30:46.544968 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.544978 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.545052 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.545151 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.547240 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.547995 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.549196 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.549593 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.549684 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.554629 (+ 4945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.554634 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.554638 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.554671 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.556519 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.557072 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.557076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.557078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.557182 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.557677 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.557681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.557684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.557937 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.558058 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.558662 (+ 604us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.558803 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260810 06:30:46.561695 1823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:46.507939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57660 (local address 127.21.195.252:45361)
0810 06:30:46.508086 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:46.508090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:46.549937 (+ 41847us) server_negotiation.cc:407] Connection header received
0810 06:30:46.550121 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:46.550124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:46.550210 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:46.550265 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:46.551848 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.552694 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.553876 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:46.554268 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:46.554365 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:46.557956 (+ 3591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:46.557961 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:46.557964 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:46.557990 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:46.559705 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.560175 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.560179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.560181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.560297 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:46.560722 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:46.560726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:46.560727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:46.560922 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:46.561053 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:46.561360 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 06:30:46.561480 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:30:47.493425 1912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:47.492960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.194:37805)
0810 06:30:47.493221 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:47.493319 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":84,"threads_started":1}
W20260810 06:30:47.493809 1584 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:44679 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
I20260810 06:30:47.494187 1914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:47.493772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.195:40125)
0810 06:30:47.494010 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:47.494084 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":80,"threads_started":1}
W20260810 06:30:47.494833 1801 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:44679 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
I20260810 06:30:47.495164 1917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:47.494496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.193:50149)
0810 06:30:47.494763 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:47.495064 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":99,"threads_started":1}
W20260810 06:30:47.495573 1359 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:44679 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
I20260810 06:30:48.003199 1918 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b11382a7a35f4ccfbd1cd73ef150e1df)
I20260810 06:30:48.003425 1918 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } }
I20260810 06:30:48.004531 1918 leader_election.cc:288] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b11382a7a35f4ccfbd1cd73ef150e1df (127.21.195.254:44679), 6c4db3e4436c4348978cdc30dd27112a (127.21.195.253:37987)
I20260810 06:30:48.004536 1919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b11382a7a35f4ccfbd1cd73ef150e1df)
I20260810 06:30:48.004741 1919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } }
I20260810 06:30:48.005451 1920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.004709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:34124)
0810 06:30:48.005222 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.005335 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":75,"threads_started":1}
W20260810 06:30:48.005822 1048 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
I20260810 06:30:48.006313 1919 leader_election.cc:288] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b11382a7a35f4ccfbd1cd73ef150e1df (127.21.195.254:44679), 65ba81615c5042ecb443658951d971c6 (127.21.195.252:45361)
I20260810 06:30:48.006546 1927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.006018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:34130)
0810 06:30:48.006378 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.006449 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":81,"threads_started":1}
W20260810 06:30:48.006723 750 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
I20260810 06:30:48.007310 1920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.007049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:34138)
0810 06:30:48.007187 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.007239 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260810 06:30:48.007476 1048 leader_election.cc:334] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b11382a7a35f4ccfbd1cd73ef150e1df (127.21.195.254:44679): Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
I20260810 06:30:48.007618 1927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.007403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:34140)
0810 06:30:48.007497 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.007548 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 06:30:48.007758 750 leader_election.cc:334] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b11382a7a35f4ccfbd1cd73ef150e1df (127.21.195.254:44679): Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
I20260810 06:30:48.009826 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.005085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:37987 (local address 127.0.0.1:56764)
0810 06:30:48.005384 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.005400 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:48.005540 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:48.005793 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:48.005797 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:48.005820 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:48.006020 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.006032 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.007170 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.007174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.008532 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.008543 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.009363 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.009366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.009448 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.009468 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:30:48.009582 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 06:30:48.009700 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":396,"thread_start_us":89,"threads_started":1}
I20260810 06:30:48.009825 1923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.005192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56764 (local address 127.21.195.253:37987)
0810 06:30:48.005506 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:48.005533 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:48.005551 (+ 18us) server_negotiation.cc:407] Connection header received
0810 06:30:48.005634 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:48.005637 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:48.005684 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:48.005772 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:48.006240 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.007023 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.008659 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.009254 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.009370 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.009426 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:48.009614 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 06:30:48.009700 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":91,"threads_started":1}
I20260810 06:30:48.010311 789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ba81615c5042ecb443658951d971c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6c4db3e4436c4348978cdc30dd27112a" is_pre_election: true
I20260810 06:30:48.010564 789 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65ba81615c5042ecb443658951d971c6 in term 1.
I20260810 06:30:48.010721 1929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.006316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36032 (local address 127.21.195.252:45361)
0810 06:30:48.006754 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:48.006763 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:48.006774 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:30:48.006869 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:48.006872 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:48.006932 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:48.007285 (+ 353us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:48.007527 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.008205 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.009566 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.010171 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.010281 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.010328 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:48.010519 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 06:30:48.010589 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":373,"thread_start_us":91,"threads_started":1}
I20260810 06:30:48.010782 1928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.006144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:45361 (local address 127.0.0.1:36032)
0810 06:30:48.006539 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.006552 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:48.006645 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:48.007060 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:48.007064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:48.007084 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:48.007180 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.007187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.008315 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.008318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.009432 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.009441 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.010294 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.010298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.010399 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.010419 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:30:48.010483 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 06:30:48.010570 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":57,"threads_started":1}
I20260810 06:30:48.011003 1048 leader_election.cc:302] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65ba81615c5042ecb443658951d971c6, 6c4db3e4436c4348978cdc30dd27112a; no voters: b11382a7a35f4ccfbd1cd73ef150e1df
I20260810 06:30:48.011260 1918 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 06:30:48.011322 1918 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b11382a7a35f4ccfbd1cd73ef150e1df)
I20260810 06:30:48.011369 1918 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:30:48.011608 1093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6c4db3e4436c4348978cdc30dd27112a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "65ba81615c5042ecb443658951d971c6" is_pre_election: true
I20260810 06:30:48.012524 1918 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } }
I20260810 06:30:48.012792 1093 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c4db3e4436c4348978cdc30dd27112a in current term 2: Already voted for candidate 65ba81615c5042ecb443658951d971c6 in this term.
I20260810 06:30:48.012916 1918 leader_election.cc:288] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [CANDIDATE]: Term 2 election: Requested vote from peers b11382a7a35f4ccfbd1cd73ef150e1df (127.21.195.254:44679), 6c4db3e4436c4348978cdc30dd27112a (127.21.195.253:37987)
I20260810 06:30:48.013355 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.013096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:34144)
0810 06:30:48.013196 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.013286 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 06:30:48.013492 789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65ba81615c5042ecb443658951d971c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "6c4db3e4436c4348978cdc30dd27112a"
I20260810 06:30:48.013641 789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:30:48.014724 789 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65ba81615c5042ecb443658951d971c6 in term 2.
I20260810 06:30:48.015127 1048 leader_election.cc:302] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65ba81615c5042ecb443658951d971c6, 6c4db3e4436c4348978cdc30dd27112a; no voters:
I20260810 06:30:48.015165 755 leader_election.cc:302] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c4db3e4436c4348978cdc30dd27112a; no voters: 65ba81615c5042ecb443658951d971c6, b11382a7a35f4ccfbd1cd73ef150e1df
I20260810 06:30:48.015390 1919 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:30:48.015527 1918 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:30:48.015663 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.015406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:34154)
0810 06:30:48.015537 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.015595 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 06:30:48.015766 1918 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [term 2 LEADER]: Becoming Leader. State: Replica: 65ba81615c5042ecb443658951d971c6, State: Running, Role: LEADER
W20260810 06:30:48.015767 1048 leader_election.cc:334] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b11382a7a35f4ccfbd1cd73ef150e1df (127.21.195.254:44679): Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
I20260810 06:30:48.016070 1918 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } }
I20260810 06:30:48.017271 1931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ba81615c5042ecb443658951d971c6. Latest consensus state: current_term: 2 leader_uuid: "65ba81615c5042ecb443658951d971c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:48.017377 1931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:48.017706 1933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:48.020313 1933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:48.020720 1933 catalog_manager.cc:1259] Loaded cluster ID: c6d1955a697a485fb28a910913571718
I20260810 06:30:48.020764 1933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:48.021297 1933 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:48.021721 1933 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Loaded TSK: 0
I20260810 06:30:48.022460 1933 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:30:48.029146 1070 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:48.032459 1070 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:48.035905 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.035626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:34170)
0810 06:30:48.035746 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.035814 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 06:30:48.036243 789 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [term 2 FOLLOWER]: Refusing update from remote peer 65ba81615c5042ecb443658951d971c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260810 06:30:48.036798 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.036557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.0.0.1:34182)
0810 06:30:48.036661 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.036723 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 06:30:48.036898 1048 consensus_peers.cc:487] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 -> Peer b11382a7a35f4ccfbd1cd73ef150e1df (127.21.195.254:44679): Couldn't send request to peer b11382a7a35f4ccfbd1cd73ef150e1df. Status: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 06:30:48.036938 1918 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260810 06:30:48.038612 1919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65ba81615c5042ecb443658951d971c6. Latest consensus state: current_term: 2 leader_uuid: "65ba81615c5042ecb443658951d971c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:48.038749 1919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:30:48.039933 1931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "65ba81615c5042ecb443658951d971c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:48.040096 1931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6 [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:48.040403 1936 mvcc.cc:205] Tried to move back new op lower bound from 7316862763150127104 to 7316862763076100096. Current Snapshot: MvccSnapshot[applied={T|T < 7316862763150127104}]
I20260810 06:30:48.040429 1919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "65ba81615c5042ecb443658951d971c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "b11382a7a35f4ccfbd1cd73ef150e1df" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44679 } } peers { permanent_uuid: "6c4db3e4436c4348978cdc30dd27112a" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 37987 } attrs { promote: false } } peers { permanent_uuid: "65ba81615c5042ecb443658951d971c6" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 45361 } attrs { promote: false } } }
I20260810 06:30:48.040575 1919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c4db3e4436c4348978cdc30dd27112a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:30:48.051620 1946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.048001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51148 (local address 127.21.195.193:39089)
0810 06:30:48.048359 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:48.048364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:48.048377 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:30:48.048429 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:48.048431 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:48.048476 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:48.048562 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:48.048829 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.049407 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.050473 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.051069 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.051187 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.051245 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:48.051403 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 06:30:48.051479 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":104,"threads_started":1}
I20260810 06:30:48.051644 1920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.047406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39089 (local address 127.0.0.1:51148)
0810 06:30:48.047660 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.047671 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:48.047759 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:48.048588 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:48.048591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:48.048612 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:48.048722 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.048728 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.049535 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.049539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.050319 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.050330 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.051173 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.051176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.051279 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.051303 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 06:30:48.051374 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:30:48.051457 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":5,"spinlock_wait_cycles":6144,"thread_start_us":104,"threads_started":1}
I20260810 06:30:48.051781 1921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.046909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:35697 (local address 127.0.0.1:37134)
0810 06:30:48.047322 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.047338 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:48.047418 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:48.047907 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:48.047909 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:48.047924 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:48.048028 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.048034 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.049065 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.049068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.050484 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.050495 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.051436 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.051440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.051528 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.051552 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 06:30:48.051597 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 06:30:48.051656 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":140}
I20260810 06:30:48.052208 1944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.047192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:44199 (local address 127.0.0.1:51226)
0810 06:30:48.047656 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.047669 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:48.047759 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:48.048065 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:48.048068 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:48.048085 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:48.048178 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.048184 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.049016 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.049019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.050485 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.050495 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.051839 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.051843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.051936 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.051958 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 06:30:48.052022 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 06:30:48.052095 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":110,"spinlock_wait_cycles":3712}
I20260810 06:30:48.052311 1941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.047035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37134 (local address 127.21.195.194:35697)
0810 06:30:48.047670 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:48.047675 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:48.047690 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:48.047748 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:48.047751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:48.047801 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:48.047899 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:48.048173 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.048927 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.050656 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.051306 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.051998 (+ 692us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.052051 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:48.052090 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 06:30:48.052167 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":139,"threads_started":1}
I20260810 06:30:48.052348 1249 tablet_service.cc:1467] Processing CreateTablet for tablet 418f18af113d4431a6fae6348a3fb050 (DEFAULT_TABLE table=test-table [id=94128e2a11954a8d92c09aaf65ff9940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:48.052618 1942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.047327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51226 (local address 127.21.195.195:44199)
0810 06:30:48.047847 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:48.047851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:48.047864 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:30:48.047913 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:48.047915 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:48.047959 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:48.048052 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:48.048284 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.048926 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.050656 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.051297 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.051424 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.051488 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:48.052137 (+ 649us) server_negotiation.cc:299] Negotiation successful
0810 06:30:48.052227 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":113,"threads_started":1}
I20260810 06:30:48.052719 1249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418f18af113d4431a6fae6348a3fb050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:48.052851 1486 tablet_service.cc:1467] Processing CreateTablet for tablet 418f18af113d4431a6fae6348a3fb050 (DEFAULT_TABLE table=test-table [id=94128e2a11954a8d92c09aaf65ff9940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:48.053123 1486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418f18af113d4431a6fae6348a3fb050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:48.053120 1692 tablet_service.cc:1467] Processing CreateTablet for tablet 418f18af113d4431a6fae6348a3fb050 (DEFAULT_TABLE table=test-table [id=94128e2a11954a8d92c09aaf65ff9940]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:48.053378 1692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418f18af113d4431a6fae6348a3fb050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:48.055512 1948 tablet_bootstrap.cc:492] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: Bootstrap starting.
I20260810 06:30:48.055821 1949 tablet_bootstrap.cc:492] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07: Bootstrap starting.
I20260810 06:30:48.056501 1948 tablet_bootstrap.cc:654] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:48.056720 1949 tablet_bootstrap.cc:654] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:48.057391 1953 tablet_bootstrap.cc:492] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: Bootstrap starting.
I20260810 06:30:48.057960 1948 tablet_bootstrap.cc:492] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: No bootstrap required, opened a new log
I20260810 06:30:48.057989 1949 tablet_bootstrap.cc:492] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07: No bootstrap required, opened a new log
I20260810 06:30:48.058066 1948 ts_tablet_manager.cc:1397] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:48.058076 1949 ts_tablet_manager.cc:1397] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:30:48.058422 1953 tablet_bootstrap.cc:654] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:48.058522 1948 raft_consensus.cc:348] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.058543 1949 raft_consensus.cc:348] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.058650 1948 raft_consensus.cc:374] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:48.058656 1949 raft_consensus.cc:374] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:48.058678 1948 raft_consensus.cc:729] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 061f017a96d740a191b5ffd328739270, State: Initialized, Role: FOLLOWER
I20260810 06:30:48.058689 1949 raft_consensus.cc:729] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ded8b07f419469788803f6960172b07, State: Initialized, Role: FOLLOWER
I20260810 06:30:48.058832 1948 consensus_queue.cc:260] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.058837 1949 consensus_queue.cc:260] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.059180 1949 ts_tablet_manager.cc:1428] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:48.059175 1948 ts_tablet_manager.cc:1428] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:30:48.059633 1953 tablet_bootstrap.cc:492] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: No bootstrap required, opened a new log
I20260810 06:30:48.059727 1953 ts_tablet_manager.cc:1397] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:30:48.060014 1960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.059515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.194:53373)
0810 06:30:48.059811 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.059899 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":110,"threads_started":1}
I20260810 06:30:48.060135 1953 raft_consensus.cc:348] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.060258 1953 raft_consensus.cc:374] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:48.060300 1953 raft_consensus.cc:729] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 496083a81d6246a585fc3c85be0c6d39, State: Initialized, Role: FOLLOWER
I20260810 06:30:48.060442 1953 consensus_queue.cc:260] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.060791 1953 ts_tablet_manager.cc:1428] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:48.060912 1960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.060457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.194:41401)
0810 06:30:48.060760 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.060828 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":103,"threads_started":1}
I20260810 06:30:48.061656 1961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.060050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.193:36119)
0810 06:30:48.061457 (+ 1407us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.061552 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1326,"thread_start_us":99,"threads_started":1}
I20260810 06:30:48.062218 1585 heartbeater.cc:503] Master 127.21.195.252:45361 was elected leader, sending a full tablet report...
I20260810 06:30:48.063416 1966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.062779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.195:50611)
0810 06:30:48.063263 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.063322 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":115,"threads_started":1}
I20260810 06:30:48.064455 1805 heartbeater.cc:503] Master 127.21.195.252:45361 was elected leader, sending a full tablet report...
I20260810 06:30:48.065853 1966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.064715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.195:44683)
0810 06:30:48.065725 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.065782 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":934}
I20260810 06:30:48.066159 1360 heartbeater.cc:503] Master 127.21.195.252:45361 was elected leader, sending a full tablet report...
I20260810 06:30:48.066324 1961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.065946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.193:38817)
0810 06:30:48.066199 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.066254 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
I20260810 06:30:48.127452 1959 raft_consensus.cc:482] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:48.127621 1959 raft_consensus.cc:504] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.128840 1959 leader_election.cc:288] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697), 496083a81d6246a585fc3c85be0c6d39 (127.21.195.195:44199)
I20260810 06:30:48.134172 1942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.129566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:44427 (local address 127.21.195.195:44199)
0810 06:30:48.129716 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:48.129721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:48.129853 (+ 132us) server_negotiation.cc:407] Connection header received
0810 06:30:48.129948 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:48.129951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:48.130003 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:48.130077 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:48.130323 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.131053 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.132720 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.133360 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.133490 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.133575 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:48.133925 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 06:30:48.134028 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:30:48.134172 1941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.129247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:38863 (local address 127.21.195.194:35697)
0810 06:30:48.129388 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:48.129393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:48.129409 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:30:48.129489 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:48.129492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:48.129563 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:48.129983 (+ 420us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:48.130101 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.130918 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.132720 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.133353 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.133490 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.133575 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:48.133925 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 06:30:48.134038 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 06:30:48.134176 1961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.129124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:35697 (local address 127.21.195.193:38863)
0810 06:30:48.129247 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.129261 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:48.129391 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:48.129688 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:48.129691 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:48.129713 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:48.129861 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.129869 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.131028 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.131031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.132552 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.132568 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.133503 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.133507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.133726 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.133777 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 06:30:48.133861 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 06:30:48.133992 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":172}
I20260810 06:30:48.134184 1974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.129416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:44199 (local address 127.21.195.193:44427)
0810 06:30:48.129765 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.129776 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:48.129869 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:48.130087 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:48.130089 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:48.130100 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:48.130207 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.130211 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.131166 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.131170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.132552 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:48.132567 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.133503 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.133507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:48.133726 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.133777 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 06:30:48.133861 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 06:30:48.133992 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":126,"thread_start_us":165,"threads_started":1}
I20260810 06:30:48.134816 1516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418f18af113d4431a6fae6348a3fb050" candidate_uuid: "1ded8b07f419469788803f6960172b07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "061f017a96d740a191b5ffd328739270" is_pre_election: true
I20260810 06:30:48.134907 1725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418f18af113d4431a6fae6348a3fb050" candidate_uuid: "1ded8b07f419469788803f6960172b07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "496083a81d6246a585fc3c85be0c6d39" is_pre_election: true
I20260810 06:30:48.135006 1516 raft_consensus.cc:2454] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ded8b07f419469788803f6960172b07 in term 0.
I20260810 06:30:48.135215 1725 raft_consensus.cc:2454] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ded8b07f419469788803f6960172b07 in term 0.
I20260810 06:30:48.135478 1180 leader_election.cc:302] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061f017a96d740a191b5ffd328739270, 1ded8b07f419469788803f6960172b07; no voters:
I20260810 06:30:48.135816 1959 raft_consensus.cc:2781] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:48.135878 1959 raft_consensus.cc:482] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:48.135905 1959 raft_consensus.cc:3037] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:48.137054 1959 raft_consensus.cc:504] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.137421 1959 leader_election.cc:288] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [CANDIDATE]: Term 1 election: Requested vote from peers 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697), 496083a81d6246a585fc3c85be0c6d39 (127.21.195.195:44199)
I20260810 06:30:48.137853 1516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418f18af113d4431a6fae6348a3fb050" candidate_uuid: "1ded8b07f419469788803f6960172b07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "061f017a96d740a191b5ffd328739270"
I20260810 06:30:48.137918 1725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418f18af113d4431a6fae6348a3fb050" candidate_uuid: "1ded8b07f419469788803f6960172b07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "496083a81d6246a585fc3c85be0c6d39"
I20260810 06:30:48.138000 1516 raft_consensus.cc:3037] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:48.138048 1725 raft_consensus.cc:3037] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:48.139005 1516 raft_consensus.cc:2454] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ded8b07f419469788803f6960172b07 in term 1.
I20260810 06:30:48.139014 1725 raft_consensus.cc:2454] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ded8b07f419469788803f6960172b07 in term 1.
I20260810 06:30:48.139309 1180 leader_election.cc:302] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 061f017a96d740a191b5ffd328739270, 1ded8b07f419469788803f6960172b07; no voters:
I20260810 06:30:48.139487 1959 raft_consensus.cc:2781] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:48.139722 1959 raft_consensus.cc:686] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 1 LEADER]: Becoming Leader. State: Replica: 1ded8b07f419469788803f6960172b07, State: Running, Role: LEADER
I20260810 06:30:48.140203 1959 consensus_queue.cc:237] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } }
I20260810 06:30:48.140525 1961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.140218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.193:49173)
0810 06:30:48.140363 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.140433 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 06:30:48.143368 1074 catalog_manager.cc:5495] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ded8b07f419469788803f6960172b07 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "1ded8b07f419469788803f6960172b07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ded8b07f419469788803f6960172b07" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39089 } health_report { overall_health: HEALTHY } } }
I20260810 06:30:48.176972 1946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.173648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51150 (local address 127.21.195.193:39089)
0810 06:30:48.173783 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:48.173786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:48.173818 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:30:48.173906 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:48.173908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:48.173971 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:48.174060 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:48.174272 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.174791 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.175612 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:48.175831 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:48.175906 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:48.176110 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:48.176641 (+ 531us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:48.176734 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:48.176780 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 06:30:48.176842 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:30:48.180203 1516 raft_consensus.cc:1261] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 1 FOLLOWER]: Refusing update from remote peer 1ded8b07f419469788803f6960172b07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:48.180428 1725 raft_consensus.cc:1261] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 1 FOLLOWER]: Refusing update from remote peer 1ded8b07f419469788803f6960172b07: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:48.180788 1959 consensus_queue.cc:1035] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "061f017a96d740a191b5ffd328739270" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:48.181056 1975 consensus_queue.cc:1035] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "496083a81d6246a585fc3c85be0c6d39" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 44199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:48.183081 1962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.182515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.194:59751)
0810 06:30:48.182873 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.182958 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279}
I20260810 06:30:48.184434 1966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.182900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.195:44855)
0810 06:30:48.184287 (+ 1387us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.184351 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1312}
I20260810 06:30:48.186673 1961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.185711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.193:46073)
0810 06:30:48.186526 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.186589 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":736}
I20260810 06:30:48.187117 1962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.186828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.194:49707)
0810 06:30:48.186986 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.187041 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260810 06:30:48.188628 1961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.188279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.193:46563)
0810 06:30:48.188485 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.188544 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260810 06:30:48.190071 1983 mvcc.cc:205] Tried to move back new op lower bound from 7316862763740237824 to 7316862763585196032. Current Snapshot: MvccSnapshot[applied={T|T < 7316862763740237824}]
I20260810 06:30:48.191184 1966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.190897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44679 (local address 127.21.195.195:49545)
0810 06:30:48.191050 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.191107 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:44679: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260810 06:30:48.196671 1074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:48.196853 1074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:48.201959 1074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 65ba81615c5042ecb443658951d971c6: Sending DeleteTablet for 3 replicas of tablet 418f18af113d4431a6fae6348a3fb050
I20260810 06:30:48.202785 1486 tablet_service.cc:1514] Processing DeleteTablet for tablet 418f18af113d4431a6fae6348a3fb050 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:48 UTC) from {username='oryx', principal='oryx/127.21.195.252@KRBTEST.COM'} at 127.0.0.1:37134
I20260810 06:30:48.203080 1692 tablet_service.cc:1514] Processing DeleteTablet for tablet 418f18af113d4431a6fae6348a3fb050 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:48 UTC) from {username='oryx', principal='oryx/127.21.195.252@KRBTEST.COM'} at 127.0.0.1:51226
I20260810 06:30:48.203313 1992 tablet_replica.cc:330] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: stopping tablet replica
I20260810 06:30:48.203459 1992 raft_consensus.cc:2229] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:48.203459 1249 tablet_service.cc:1514] Processing DeleteTablet for tablet 418f18af113d4431a6fae6348a3fb050 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:48 UTC) from {username='oryx', principal='oryx/127.21.195.252@KRBTEST.COM'} at 127.0.0.1:51148
I20260810 06:30:48.203609 1992 raft_consensus.cc:2258] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:48.203883 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 1013
I20260810 06:30:48.203995 1994 tablet_replica.cc:330] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07: stopping tablet replica
I20260810 06:30:48.204149 1994 raft_consensus.cc:2229] T 418f18af113d4431a6fae6348a3fb050 P 1ded8b07f419469788803f6960172b07 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:48.205071 1993 tablet_replica.cc:330] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: stopping tablet replica
I20260810 06:30:48.205197 1993 raft_consensus.cc:2229] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:48.205313 1993 raft_consensus.cc:2258] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:48.208161 1993 ts_tablet_manager.cc:1905] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:48.210867 1993 ts_tablet_manager.cc:1918] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:48.210953 1993 log.cc:1196] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/418f18af113d4431a6fae6348a3fb050
I20260810 06:30:48.211205 1993 ts_tablet_manager.cc:1939] T 418f18af113d4431a6fae6348a3fb050 P 496083a81d6246a585fc3c85be0c6d39: Deleting consensus metadata
I20260810 06:30:48.212070 1051 catalog_manager.cc:4841] TS 496083a81d6246a585fc3c85be0c6d39 (127.21.195.195:44199): tablet 418f18af113d4431a6fae6348a3fb050 (table test-table [id=94128e2a11954a8d92c09aaf65ff9940]) successfully deleted
I20260810 06:30:48.213665 1992 ts_tablet_manager.cc:1905] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:48.216125 1992 ts_tablet_manager.cc:1918] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:48.216212 1992 log.cc:1196] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/418f18af113d4431a6fae6348a3fb050
I20260810 06:30:48.216485 1992 ts_tablet_manager.cc:1939] T 418f18af113d4431a6fae6348a3fb050 P 061f017a96d740a191b5ffd328739270: Deleting consensus metadata
I20260810 06:30:48.217288 1051 catalog_manager.cc:4841] TS 061f017a96d740a191b5ffd328739270 (127.21.195.194:35697): tablet 418f18af113d4431a6fae6348a3fb050 (table test-table [id=94128e2a11954a8d92c09aaf65ff9940]) successfully deleted
I20260810 06:30:48.221256 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 1373
I20260810 06:30:48.224774 1944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:48.221305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39089 (local address 127.0.0.1:51166)
0810 06:30:48.221462 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:48.224668 (+ 3206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:39089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 06:30:48.225064 1051 catalog_manager.cc:4584] TS 1ded8b07f419469788803f6960172b07 (127.21.195.193:39089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 418f18af113d4431a6fae6348a3fb050: Network error: Client connection negotiation failed: client connection to 127.21.195.193:39089: connect: Connection refused (error 111)
I20260810 06:30:48.235635 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 1596
I20260810 06:30:48.260329 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 542
I20260810 06:30:48.283783 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 716
2026-08-10T06:30:48Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5846 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:48 dist-test-slave-7lbf krb5kdc[2000](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:48 dist-test-slave-7lbf krb5kdc[2000](info): set up 2 sockets
Aug 10 06:30:48 dist-test-slave-7lbf krb5kdc[2000](info): commencing operation
krb5kdc: starting...
W20260810 06:30:49.467154 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:49 dist-test-slave-7lbf krb5kdc[2000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:49Z Disabled control of system clock
WARNING: no policy specified for oryx/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.254.keytab.
Entry for principal oryx/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.254.keytab.
I20260810 06:30:49.600167 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46231
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.254.keytab
--principal=oryx/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:46231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:49.724465 2019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:49.724869 2019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:49.724946 2019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:49.729395 2019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:49.729481 2019 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 06:30:49.729507 2019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:49.729557 2019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:49.729579 2019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:49.729609 2019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:49.735888 2019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:46231
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.254.keytab
--principal=oryx/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:49.737231 2019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:49.738471 2019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:49.748073 2030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:49.748096 2035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:49.748111 2031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:49.748518 2019 server_base.cc:1034] running on GCE node
I20260810 06:30:49.749205 2019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:49.750564 2019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:49.751744 2019 hybrid_clock.cc:648] HybridClock initialized: now 1786343449751729 us; error 36 us; skew 500 ppm
Aug 10 06:30:49 dist-test-slave-7lbf krb5kdc[2000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343449, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:49.754834 2019 init.cc:377] Logged in from keytab as oryx/127.21.195.254@KRBTEST.COM (short username oryx)
I20260810 06:30:49.755867 2019 webserver.cc:460] Webserver started at http://127.21.195.254:46431/ using document root <none> and password file <none>
I20260810 06:30:49.756448 2019 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:49.756515 2019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:49.756713 2019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:49.759056 2019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "1eda35f94e3f4e0c88b8406e7287edec"
format_stamp: "Formatted at 2026-08-10 06:30:49 on dist-test-slave-7lbf"
server_key: "70c90e50ad5bc1fc718c0388ada1f1fe"
server_key_iv: "83c2ce94600d1cb236e8908bb00ff310"
server_key_version: "encryptionkey@0"
I20260810 06:30:49.759649 2019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "1eda35f94e3f4e0c88b8406e7287edec"
format_stamp: "Formatted at 2026-08-10 06:30:49 on dist-test-slave-7lbf"
server_key: "70c90e50ad5bc1fc718c0388ada1f1fe"
server_key_iv: "83c2ce94600d1cb236e8908bb00ff310"
server_key_version: "encryptionkey@0"
I20260810 06:30:49.763967 2019 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:49.766721 2044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:49.768090 2019 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:49.768222 2019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "1eda35f94e3f4e0c88b8406e7287edec"
format_stamp: "Formatted at 2026-08-10 06:30:49 on dist-test-slave-7lbf"
server_key: "70c90e50ad5bc1fc718c0388ada1f1fe"
server_key_iv: "83c2ce94600d1cb236e8908bb00ff310"
server_key_version: "encryptionkey@0"
I20260810 06:30:49.768349 2019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:49.785619 2019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:49.788973 2019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:49.789170 2019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:49.797816 2019 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:46231
I20260810 06:30:49.797871 2144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:46231 every 8 connection(s)
I20260810 06:30:49.798918 2019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:49.802083 2145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:49.808346 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 2019
I20260810 06:30:49.808493 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:49.808568 2145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: Bootstrap starting.
I20260810 06:30:49.808811 22287 external_mini_cluster.cc:1428] Setting key 5ae3247a8771ebd65ba629a2878bdbd4
I20260810 06:30:49.811578 2145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:49.812409 2145 log.cc:824] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:49.814661 2145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: No bootstrap required, opened a new log
Aug 10 06:30:49 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343449, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:49.818918 2145 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eda35f94e3f4e0c88b8406e7287edec" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46231 } }
I20260810 06:30:49.819219 2145 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:49.819288 2145 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eda35f94e3f4e0c88b8406e7287edec, State: Initialized, Role: FOLLOWER
I20260810 06:30:49.819851 2145 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eda35f94e3f4e0c88b8406e7287edec" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46231 } }
I20260810 06:30:49.820043 2145 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:49.820129 2145 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:49.820240 2145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:49.821229 2145 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eda35f94e3f4e0c88b8406e7287edec" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46231 } }
I20260810 06:30:49.821652 2145 leader_election.cc:302] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1eda35f94e3f4e0c88b8406e7287edec; no voters:
I20260810 06:30:49.822003 2145 leader_election.cc:288] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:49.822131 2155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:49.822369 2155 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [term 1 LEADER]: Becoming Leader. State: Replica: 1eda35f94e3f4e0c88b8406e7287edec, State: Running, Role: LEADER
I20260810 06:30:49.822736 2155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eda35f94e3f4e0c88b8406e7287edec" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46231 } }
I20260810 06:30:49.823413 2145 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:49.824155 2155 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eda35f94e3f4e0c88b8406e7287edec. Latest consensus state: current_term: 1 leader_uuid: "1eda35f94e3f4e0c88b8406e7287edec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eda35f94e3f4e0c88b8406e7287edec" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46231 } } }
I20260810 06:30:49.824275 2155 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:49.824633 2157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1eda35f94e3f4e0c88b8406e7287edec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eda35f94e3f4e0c88b8406e7287edec" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46231 } } }
I20260810 06:30:49.824733 2157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:49.824764 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:49.810412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44086 (local address 127.21.195.254:46231)
0810 06:30:49.810952 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:49.810968 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:49.811009 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:30:49.811714 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:49.811742 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:49.812140 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:49.812500 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:49.813330 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:49.814415 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:49.815365 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:49.815905 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:49.816071 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:49.818888 (+ 2817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:49.818894 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:49.818912 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:49.818947 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:49.820780 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:49.821243 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:49.821250 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:49.821256 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:49.821429 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:49.821753 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:49.821757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:49.821759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:49.822389 (+ 630us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:49.823220 (+ 831us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:49.823397 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 06:30:49.823729 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":163,"threads_started":1}
I20260810 06:30:49.826138 2166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:49.829061 2166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:49.834861 2166 catalog_manager.cc:1347] Generated new cluster ID: 62afca3fd9c14531b3222d886e2c9464
I20260810 06:30:49.834945 2166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:49.855829 2166 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:49.857312 2166 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:49.874745 2166 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: Generated new TSK 0
I20260810 06:30:49.875617 2166 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab.
Entry for principal oryx/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab.
I20260810 06:30:49.915863 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46231
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab
--principal=oryx/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:50.039748 2188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:50.040082 2188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:50.040130 2188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:50.044850 2188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:50.044931 2188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:50.044975 2188 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:50.045017 2188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:50.050870 2188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab
--principal=oryx/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:46231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:50.052162 2188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:50.053376 2188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:50.063900 2202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:50.063910 2200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:50.063910 2196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:50.064527 2188 server_base.cc:1034] running on GCE node
I20260810 06:30:50.065006 2188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:50.065810 2188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:50.066972 2188 hybrid_clock.cc:648] HybridClock initialized: now 1786343450066946 us; error 40 us; skew 500 ppm
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343450, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:50.070046 2188 init.cc:377] Logged in from keytab as oryx/127.21.195.193@KRBTEST.COM (short username oryx)
I20260810 06:30:50.071094 2188 webserver.cc:460] Webserver started at http://127.21.195.193:34943/ using document root <none> and password file <none>
I20260810 06:30:50.071710 2188 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:50.071784 2188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:50.072029 2188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:50.074434 2188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "b876b6568d0d4473beb93cfd77be49f5"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "400379f5a2f9833aaabe6ab55041635d"
server_key_iv: "cd9303d082fa67fcac2a59ce4157ac67"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.075048 2188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "b876b6568d0d4473beb93cfd77be49f5"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "400379f5a2f9833aaabe6ab55041635d"
server_key_iv: "cd9303d082fa67fcac2a59ce4157ac67"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.079231 2188 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:30:50.081965 2209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:50.083431 2188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:50.083563 2188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "b876b6568d0d4473beb93cfd77be49f5"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "400379f5a2f9833aaabe6ab55041635d"
server_key_iv: "cd9303d082fa67fcac2a59ce4157ac67"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.083684 2188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:50.095309 2188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:50.098968 2188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:50.099188 2188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:50.100872 2188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:50.100932 2188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:50.100992 2188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:50.101022 2188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343450, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:50.112510 2188 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:38831
I20260810 06:30:50.112568 2377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:38831 every 8 connection(s)
I20260810 06:30:50.113683 2188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:50.114087 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 2188
I20260810 06:30:50.114223 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:50.114575 22287 external_mini_cluster.cc:1428] Setting key 6a2953df88d3a9108094409f7a6b4977
I20260810 06:30:50.115577 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.101826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:60861 (local address 127.21.195.254:46231)
0810 06:30:50.101953 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.101957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.103213 (+ 1256us) server_negotiation.cc:407] Connection header received
0810 06:30:50.104383 (+ 1170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.104387 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.104453 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.104538 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:50.105926 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.106484 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.107681 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.107930 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.108045 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.111315 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:50.111319 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:50.111321 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:50.111352 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:50.112966 (+ 1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.113606 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.113608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.113610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.113695 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.114128 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.114133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.114134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.114432 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:50.114542 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.115241 (+ 699us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.115413 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:30:50.116487 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.102486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46231 (local address 127.21.195.193:60861)
0810 06:30:50.103043 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.103091 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.104108 (+ 1017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.104744 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.104751 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.105137 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:50.105753 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.105772 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.106619 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.106622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.107540 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.107551 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.108115 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.108121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.108390 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.109121 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:50.109140 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:50.111098 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:50.113085 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.113091 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.113108 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.113481 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.113788 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.113791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.113793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.113994 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.114556 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:50.114563 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:50.114889 (+ 326us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.115072 (+ 183us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.115454 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":165,"threads_started":1}
I20260810 06:30:50.118341 2380 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46231
I20260810 06:30:50.118522 2380 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:50.119151 2380 heartbeater.cc:511] Master 127.21.195.254:46231 requested a full tablet report, sending...
I20260810 06:30:50.120985 2075 ts_manager.cc:194] Registered new tserver with Master: b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193:38831)
I20260810 06:30:50.122737 2075 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:60861
WARNING: no policy specified for oryx/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:50.130863 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.120408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:55883 (local address 127.21.195.254:46231)
0810 06:30:50.120534 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.120538 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.123900 (+ 3362us) server_negotiation.cc:407] Connection header received
0810 06:30:50.124051 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.124053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.124098 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.124154 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:50.124706 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.125275 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.126218 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.126557 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.126663 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.127797 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:50.127801 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:50.127804 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:50.127834 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:50.129233 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.129706 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.129709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.129710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.129798 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.130032 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.130034 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.130035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.130204 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:50.130275 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.130601 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.130711 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:30:50.130897 2392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.120316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46231 (local address 127.21.195.193:55883)
0810 06:30:50.123789 (+ 3473us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.123807 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.123950 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.124201 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.124204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.124448 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:50.124572 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.124579 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.125414 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.125417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.126094 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.126104 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.126678 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.126680 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.126754 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.127273 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:50.127285 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:50.127632 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:50.129351 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.129355 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.129357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.129629 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.129883 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.129885 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.129886 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.129964 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.130318 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:50.130321 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:50.130425 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.130555 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.130721 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3317,"thread_start_us":141,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab.
Entry for principal oryx/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab.
I20260810 06:30:50.146603 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46231
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab
--principal=oryx/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:50.271350 2395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:50.271687 2395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:50.271735 2395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:50.276113 2395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:50.276202 2395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:50.276247 2395 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:50.276279 2395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:50.282064 2395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab
--principal=oryx/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:46231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:50.283340 2395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:50.284565 2395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:50.295430 2403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:50.295519 2395 server_base.cc:1034] running on GCE node
W20260810 06:30:50.295423 2404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:50.295430 2406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:50.296229 2395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:50.296945 2395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:50.298143 2395 hybrid_clock.cc:648] HybridClock initialized: now 1786343450298117 us; error 38 us; skew 500 ppm
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343450, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:50.301153 2395 init.cc:377] Logged in from keytab as oryx/127.21.195.194@KRBTEST.COM (short username oryx)
I20260810 06:30:50.302237 2395 webserver.cc:460] Webserver started at http://127.21.195.194:46639/ using document root <none> and password file <none>
I20260810 06:30:50.302868 2395 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:50.302947 2395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:50.303177 2395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:50.305442 2395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "78e7ed68221f430293480ec0caeda67f"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "ffbf0dddeb0dbecd848365f98ad9f481"
server_key_iv: "df2dc50dbf54ae9d21ceb04367f95f96"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.306102 2395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "78e7ed68221f430293480ec0caeda67f"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "ffbf0dddeb0dbecd848365f98ad9f481"
server_key_iv: "df2dc50dbf54ae9d21ceb04367f95f96"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.310442 2395 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:50.313196 2418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:50.314599 2395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:30:50.314751 2395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "78e7ed68221f430293480ec0caeda67f"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "ffbf0dddeb0dbecd848365f98ad9f481"
server_key_iv: "df2dc50dbf54ae9d21ceb04367f95f96"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.314870 2395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:50.328948 2395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:50.332103 2395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:50.332304 2395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:50.334048 2395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:50.334110 2395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:50.334170 2395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:50.334198 2395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:50.344750 2395 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:46411
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343450, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:50.344820 2603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:46411 every 8 connection(s)
I20260810 06:30:50.345809 2395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:50.349268 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.334814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:52739 (local address 127.21.195.254:46231)
0810 06:30:50.334956 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.334961 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.336016 (+ 1055us) server_negotiation.cc:407] Connection header received
0810 06:30:50.337173 (+ 1157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.337177 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.337238 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.337320 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:50.339195 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.340037 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.341900 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.342140 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.342233 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.345583 (+ 3350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:50.345586 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:50.345588 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:50.345617 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:50.347141 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.347663 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.347666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.347668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.347754 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.348091 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.348095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.348097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.348306 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:50.348410 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.348945 (+ 535us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.349095 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:30:50.350171 2434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.335316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46231 (local address 127.21.195.194:52739)
0810 06:30:50.335818 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.335885 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.336919 (+ 1034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.337630 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.337640 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.338203 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:50.338999 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.339024 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.340187 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.340191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.341756 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.341768 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.342310 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.342315 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.342567 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.343337 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:50.343360 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:50.345367 (+ 2007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:50.347259 (+ 1892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.347265 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.347283 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.347559 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.347843 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.347846 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.347848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.347998 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.348420 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:50.348428 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:50.348697 (+ 269us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.348879 (+ 182us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.349234 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":120,"threads_started":1}
I20260810 06:30:50.351434 2605 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46231
I20260810 06:30:50.351601 2605 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:50.352125 2605 heartbeater.cc:511] Master 127.21.195.254:46231 requested a full tablet report, sending...
I20260810 06:30:50.353264 2073 ts_manager.cc:194] Registered new tserver with Master: 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411)
I20260810 06:30:50.353969 2073 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:52739
I20260810 06:30:50.355334 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 2395
I20260810 06:30:50.355456 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:50.355764 22287 external_mini_cluster.cc:1428] Setting key d59527f7c12794e7aea94fd3a0f3deab
I20260810 06:30:50.360666 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.353665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:54913 (local address 127.21.195.254:46231)
0810 06:30:50.353798 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.353802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.353996 (+ 194us) server_negotiation.cc:407] Connection header received
0810 06:30:50.354165 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.354168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.354217 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.354298 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:50.354754 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.355277 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.356203 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.356416 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.356534 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.357710 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:50.357714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:50.357715 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:50.357739 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:50.359038 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.359444 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.359447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.359449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.359535 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.359794 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.359797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.359799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.360026 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:50.360118 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.360379 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.360506 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:30:50.360672 2613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.353580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46231 (local address 127.21.195.194:54913)
0810 06:30:50.353919 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.353931 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.354035 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.354344 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.354347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.354534 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:50.354640 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.354646 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.355400 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.355403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.356089 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.356100 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.356535 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.356554 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.356650 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.357178 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:50.357190 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:50.357576 (+ 386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:50.359145 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.359148 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.359151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.359354 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.359621 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.359624 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.359626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.359712 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.360123 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:50.360127 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:50.360223 (+ 96us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.360312 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.360469 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for oryx/127.21.195.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab.
Entry for principal oryx/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab.
I20260810 06:30:50.385237 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46231
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab
--principal=oryx/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:50.510813 2619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:50.511160 2619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:50.511211 2619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:50.515611 2619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:50.515712 2619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:50.515784 2619 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 06:30:50.515829 2619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:50.521876 2619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab
--principal=oryx/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.195.254:46231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:50.523196 2619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:50.524384 2619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:50.535315 2626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:50.535316 2630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:50.535316 2625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:50.535576 2619 server_base.cc:1034] running on GCE node
I20260810 06:30:50.536103 2619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:50.536803 2619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:50.537986 2619 hybrid_clock.cc:648] HybridClock initialized: now 1786343450537960 us; error 39 us; skew 500 ppm
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343450, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:50.540982 2619 init.cc:377] Logged in from keytab as oryx/127.21.195.195@KRBTEST.COM (short username oryx)
I20260810 06:30:50.542117 2619 webserver.cc:460] Webserver started at http://127.21.195.195:46233/ using document root <none> and password file <none>
I20260810 06:30:50.542759 2619 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:50.542831 2619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:50.543074 2619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:50.545482 2619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "3243d44f81fb413e81f8a9d9873f9d12"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "d49a2b4da60fc9783346f4a54c7b39cd"
server_key_iv: "f9ee700c587cb851e3966ce9e244bbcd"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.546188 2619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "3243d44f81fb413e81f8a9d9873f9d12"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "d49a2b4da60fc9783346f4a54c7b39cd"
server_key_iv: "f9ee700c587cb851e3966ce9e244bbcd"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.550559 2619 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:50.553573 2649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:50.555042 2619 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:50.555184 2619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "3243d44f81fb413e81f8a9d9873f9d12"
format_stamp: "Formatted at 2026-08-10 06:30:50 on dist-test-slave-7lbf"
server_key: "d49a2b4da60fc9783346f4a54c7b39cd"
server_key_iv: "f9ee700c587cb851e3966ce9e244bbcd"
server_key_version: "encryptionkey@0"
I20260810 06:30:50.555310 2619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:50.586751 2619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:50.590137 2619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:50.590354 2619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:50.592067 2619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:50.592139 2619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:50.592201 2619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:50.592231 2619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343450, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:50.603595 2619 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:42859
I20260810 06:30:50.603768 2829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:42859 every 8 connection(s)
I20260810 06:30:50.604790 2619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:50.606546 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.592945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:37135 (local address 127.21.195.254:46231)
0810 06:30:50.593124 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.593130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.594233 (+ 1103us) server_negotiation.cc:407] Connection header received
0810 06:30:50.595540 (+ 1307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.595544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.595610 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.595701 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:50.597161 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.597851 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.599161 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.599434 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.599538 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.602587 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:50.602590 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:50.602592 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:50.602624 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:50.604335 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.604861 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.604865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.604868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.604979 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.605339 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.605343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.605345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.605654 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:50.605766 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.606290 (+ 524us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.606409 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 06:30:50.607419 2660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.593399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46231 (local address 127.21.195.195:37135)
0810 06:30:50.594018 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.594089 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.595247 (+ 1158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.595930 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.595937 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.596363 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:50.596973 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.597007 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.597998 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.598001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.599030 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.599041 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.599624 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.599628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.599798 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.600396 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:50.600414 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:50.602363 (+ 1949us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:50.604456 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.604462 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.604477 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.604743 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.605073 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.605075 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.605077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.605223 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.605780 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:50.605786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:50.606055 (+ 269us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.606233 (+ 178us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.606526 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":153,"threads_started":1}
I20260810 06:30:50.608731 2830 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46231
I20260810 06:30:50.608891 2830 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:50.609493 2830 heartbeater.cc:511] Master 127.21.195.254:46231 requested a full tablet report, sending...
I20260810 06:30:50.610656 2075 ts_manager.cc:194] Registered new tserver with Master: 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:50.611310 2075 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:37135
I20260810 06:30:50.614135 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 2619
I20260810 06:30:50.614259 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:50.614557 22287 external_mini_cluster.cc:1428] Setting key feb001678c25e352196cde8f665113e7
I20260810 06:30:50.617120 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:30:50.618257 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.610932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:37637 (local address 127.21.195.254:46231)
0810 06:30:50.611078 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.611083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.611308 (+ 225us) server_negotiation.cc:407] Connection header received
0810 06:30:50.611419 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.611422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.611469 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.611543 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:50.611992 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.612511 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.613314 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.613594 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.613686 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.614840 (+ 1154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:50.614843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:50.614845 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:50.614869 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:50.616512 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.617013 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.617016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.617018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.617101 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.617390 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.617393 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.617394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.617642 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:50.617723 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.618027 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.618135 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:30:50.618315 2839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.610939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46231 (local address 127.21.195.195:37637)
0810 06:30:50.611226 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.611238 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.611337 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.611568 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.611570 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.611780 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:50.611882 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.611888 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.612631 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.612635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.613205 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.613214 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.613700 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.613704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.613797 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.614349 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:50.614362 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:50.614698 (+ 336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:50.616631 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.616634 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.616636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.616921 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.617194 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:50.617197 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:50.617199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:50.617299 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:50.617727 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:50.617730 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:50.617864 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.617987 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.618144 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":130,"threads_started":1}
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343450, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 06:30:50.644335 2150 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:50.637909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44094 (local address 127.21.195.254:46231)
0810 06:30:50.638055 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.638059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.638071 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:30:50.638115 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.638117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.638158 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.638224 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:50.639022 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.639553 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.640370 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.640580 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.640656 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.644157 (+ 3501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44094: BlockingRecv error: recv got EOF from 127.0.0.1:44094 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 06:30:50 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343450, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:50.654623 2150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.646007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44096 (local address 127.21.195.254:46231)
0810 06:30:50.646165 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.646170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.646366 (+ 196us) server_negotiation.cc:407] Connection header received
0810 06:30:50.646423 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.646426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.646473 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.646552 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:50.647197 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.647744 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.648545 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.648809 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.648936 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.651439 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:50.651443 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:50.651446 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:50.651486 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:50.653081 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.653565 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.653569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.653571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.653663 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:50.653896 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:50.653898 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:50.653899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:50.654088 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:50.654193 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.654371 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.654487 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 06:30:50.657702 2075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:50.661095 2075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:50.676575 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.671283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:42859 (local address 127.0.0.1:54876)
0810 06:30:50.671985 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.671998 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.672076 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.672712 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.672715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.672735 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:50.672821 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.672827 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.674300 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.674303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.675147 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.675157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.676107 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.676109 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.676191 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.676224 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.676305 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.676408 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
I20260810 06:30:50.676609 2869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.671751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54876 (local address 127.21.195.195:42859)
0810 06:30:50.672198 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.672208 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.672231 (+ 23us) server_negotiation.cc:407] Connection header received
0810 06:30:50.672300 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.672304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.672498 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.672738 (+ 240us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:50.672923 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.674186 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.675284 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.675992 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.676131 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.676281 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.676337 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.676450 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":117,"threads_started":1}
I20260810 06:30:50.676993 2867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.670545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46411 (local address 127.0.0.1:58060)
0810 06:30:50.671620 (+ 1075us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.671634 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.671786 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.672602 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.672605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.672624 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:50.672727 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.672734 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.673951 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.673955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.675518 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.675530 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.676602 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.676605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.676693 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.676721 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.676786 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.676850 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1011,"mutex_wait_us":105,"spinlock_wait_cycles":13312,"thread_start_us":110,"threads_started":1}
I20260810 06:30:50.677062 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.670784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58060 (local address 127.21.195.194:46411)
0810 06:30:50.671288 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.671302 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.671836 (+ 534us) server_negotiation.cc:407] Connection header received
0810 06:30:50.672030 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.672037 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.672270 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.672423 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:50.672847 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.673829 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.675659 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.676472 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.676617 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.676755 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.676815 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.676925 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":130,"threads_started":1}
I20260810 06:30:50.679402 2863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.670463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:38831 (local address 127.0.0.1:50196)
0810 06:30:50.671570 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.671631 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.671785 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.672435 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.672441 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.672462 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:50.672613 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.672621 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.674151 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.674154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.675518 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.675530 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.678967 (+ 3437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.678971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.679067 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.679093 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.679175 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.679255 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"mutex_wait_us":64,"spinlock_wait_cycles":4480,"thread_start_us":88,"threads_started":1}
I20260810 06:30:50.679462 2868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.671360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50196 (local address 127.21.195.193:38831)
0810 06:30:50.671735 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.671742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.671769 (+ 27us) server_negotiation.cc:407] Connection header received
0810 06:30:50.672024 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.672031 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.672269 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.672433 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:50.672882 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.674020 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.678013 (+ 3993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.678824 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.678959 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.679096 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.679223 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.679323 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":66,"threads_started":1}
I20260810 06:30:50.680276 2719 tablet_service.cc:1467] Processing CreateTablet for tablet 4c92a4f279ab4a9fa62d5df5c27354e1 (DEFAULT_TABLE table=test-table [id=e744a9d121dc4f3c8d01d172dc3d0b29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:50.680310 2497 tablet_service.cc:1467] Processing CreateTablet for tablet 4c92a4f279ab4a9fa62d5df5c27354e1 (DEFAULT_TABLE table=test-table [id=e744a9d121dc4f3c8d01d172dc3d0b29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:50.681416 2497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c92a4f279ab4a9fa62d5df5c27354e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:50.681439 2719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c92a4f279ab4a9fa62d5df5c27354e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:50.682860 2282 tablet_service.cc:1467] Processing CreateTablet for tablet 4c92a4f279ab4a9fa62d5df5c27354e1 (DEFAULT_TABLE table=test-table [id=e744a9d121dc4f3c8d01d172dc3d0b29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:50.684082 2282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c92a4f279ab4a9fa62d5df5c27354e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:50.688974 2870 tablet_bootstrap.cc:492] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Bootstrap starting.
I20260810 06:30:50.691511 2870 tablet_bootstrap.cc:654] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:50.691854 2872 tablet_bootstrap.cc:492] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Bootstrap starting.
I20260810 06:30:50.692613 2870 log.cc:824] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:50.692699 2871 tablet_bootstrap.cc:492] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Bootstrap starting.
I20260810 06:30:50.694348 2872 tablet_bootstrap.cc:654] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:50.694641 2870 tablet_bootstrap.cc:492] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: No bootstrap required, opened a new log
I20260810 06:30:50.694851 2870 ts_tablet_manager.cc:1397] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:30:50.695015 2871 tablet_bootstrap.cc:654] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:50.695271 2872 log.cc:824] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:50.695894 2871 log.cc:824] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:50.697440 2872 tablet_bootstrap.cc:492] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: No bootstrap required, opened a new log
I20260810 06:30:50.697736 2872 ts_tablet_manager.cc:1397] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:30:50.698208 2871 tablet_bootstrap.cc:492] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: No bootstrap required, opened a new log
I20260810 06:30:50.698408 2871 ts_tablet_manager.cc:1397] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260810 06:30:50.698796 2870 raft_consensus.cc:348] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.699050 2870 raft_consensus.cc:374] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:50.699105 2870 raft_consensus.cc:729] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e7ed68221f430293480ec0caeda67f, State: Initialized, Role: FOLLOWER
I20260810 06:30:50.699569 2870 consensus_queue.cc:260] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.700320 2605 heartbeater.cc:503] Master 127.21.195.254:46231 was elected leader, sending a full tablet report...
I20260810 06:30:50.700616 2870 ts_tablet_manager.cc:1428] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:30:50.702296 2872 raft_consensus.cc:348] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.702534 2872 raft_consensus.cc:374] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:50.702589 2872 raft_consensus.cc:729] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Initialized, Role: FOLLOWER
I20260810 06:30:50.702859 2871 raft_consensus.cc:348] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.703044 2872 consensus_queue.cc:260] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.703174 2871 raft_consensus.cc:374] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:50.703235 2871 raft_consensus.cc:729] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3243d44f81fb413e81f8a9d9873f9d12, State: Initialized, Role: FOLLOWER
I20260810 06:30:50.703704 2380 heartbeater.cc:503] Master 127.21.195.254:46231 was elected leader, sending a full tablet report...
I20260810 06:30:50.703756 2871 consensus_queue.cc:260] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.704108 2872 ts_tablet_manager.cc:1428] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:30:50.704807 2871 ts_tablet_manager.cc:1428] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:30:50.705178 2830 heartbeater.cc:503] Master 127.21.195.254:46231 was elected leader, sending a full tablet report...
W20260810 06:30:50.847363 2607 tablet.cc:2369] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:50.855973 2831 tablet.cc:2369] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:30:50.865088 2381 tablet.cc:2369] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:30:50.884455 2880 raft_consensus.cc:482] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:50.884765 2880 raft_consensus.cc:504] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.886502 2880 leader_election.cc:288] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411), 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:50.890589 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.886873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:44907 (local address 127.21.195.194:46411)
0810 06:30:50.887031 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.887037 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.887274 (+ 237us) server_negotiation.cc:407] Connection header received
0810 06:30:50.887401 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.887405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.887452 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.887529 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:50.887862 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.888444 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.889609 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.890032 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.890143 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.890205 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.890362 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.890445 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 06:30:50.890609 2869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.887170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:42897 (local address 127.21.195.195:42859)
0810 06:30:50.887318 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.887322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.887336 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:30:50.887388 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.887390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.887429 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.887494 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:50.887818 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.888444 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.889610 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.890046 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.890164 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.890219 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.890391 (+ 172us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.890470 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:30:50.890618 2884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.886796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46411 (local address 127.21.195.193:44907)
0810 06:30:50.887190 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.887204 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.887314 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.887576 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.887578 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.887621 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:50.887751 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.887755 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.888548 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.888552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.889465 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.889474 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.890143 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.890146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.890238 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.890271 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.890339 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.890423 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":64,"spinlock_wait_cycles":768,"thread_start_us":107,"threads_started":1}
I20260810 06:30:50.890623 2882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.886792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:42859 (local address 127.21.195.193:42897)
0810 06:30:50.887096 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:50.887111 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:50.887217 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:50.887535 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:50.887537 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:50.887554 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:50.887705 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.887711 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.888552 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.888555 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.889454 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:50.889464 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.890165 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.890168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:50.890277 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.890300 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 06:30:50.890365 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:30:50.890436 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":40,"spinlock_wait_cycles":24192,"thread_start_us":122,"threads_started":1}
I20260810 06:30:50.891265 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c92a4f279ab4a9fa62d5df5c27354e1" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f" is_pre_election: true
I20260810 06:30:50.891276 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c92a4f279ab4a9fa62d5df5c27354e1" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3243d44f81fb413e81f8a9d9873f9d12" is_pre_election: true
I20260810 06:30:50.891621 2757 raft_consensus.cc:2454] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 0.
I20260810 06:30:50.891621 2529 raft_consensus.cc:2454] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 0.
I20260810 06:30:50.892181 2211 leader_election.cc:302] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3243d44f81fb413e81f8a9d9873f9d12, 78e7ed68221f430293480ec0caeda67f, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:50.892499 2880 raft_consensus.cc:2781] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:50.892602 2880 raft_consensus.cc:482] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:50.892652 2880 raft_consensus.cc:3037] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:50.893858 2880 raft_consensus.cc:504] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.894213 2880 leader_election.cc:288] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 election: Requested vote from peers 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411), 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:50.894665 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c92a4f279ab4a9fa62d5df5c27354e1" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3243d44f81fb413e81f8a9d9873f9d12"
I20260810 06:30:50.894793 2757 raft_consensus.cc:3037] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:50.896131 2757 raft_consensus.cc:2454] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 1.
I20260810 06:30:50.896435 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c92a4f279ab4a9fa62d5df5c27354e1" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f"
I20260810 06:30:50.896515 2214 leader_election.cc:302] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3243d44f81fb413e81f8a9d9873f9d12, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:50.896565 2529 raft_consensus.cc:3037] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:50.896740 2880 raft_consensus.cc:2781] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:50.896968 2880 raft_consensus.cc:686] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 1 LEADER]: Becoming Leader. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Running, Role: LEADER
I20260810 06:30:50.897369 2880 consensus_queue.cc:237] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.897797 2529 raft_consensus.cc:2454] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 1.
I20260810 06:30:50.901000 2071 catalog_manager.cc:5495] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } health_report { overall_health: UNKNOWN } } }
I20260810 06:30:50.917383 2868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:50.913808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50210 (local address 127.21.195.193:38831)
0810 06:30:50.913946 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:50.913951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:50.913966 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:50.914078 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:50.914080 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:50.914138 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:50.914230 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:50.914494 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.915000 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.915856 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:50.916081 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:50.916173 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:50.916461 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:50.916967 (+ 506us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:50.917086 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:50.917157 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 06:30:50.917232 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:30:50.923965 2757 raft_consensus.cc:1261] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Refusing update from remote peer b876b6568d0d4473beb93cfd77be49f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:50.923965 2529 raft_consensus.cc:1261] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Refusing update from remote peer b876b6568d0d4473beb93cfd77be49f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:50.924793 2885 consensus_queue.cc:1035] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:50.924994 2880 consensus_queue.cc:1035] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:50.933326 2889 mvcc.cc:205] Tried to move back new op lower bound from 7316862774976675840 to 7316862774879092736. Current Snapshot: MvccSnapshot[applied={T|T < 7316862774976675840}]
I20260810 06:30:50.935192 2894 mvcc.cc:205] Tried to move back new op lower bound from 7316862774976675840 to 7316862774879092736. Current Snapshot: MvccSnapshot[applied={T|T < 7316862774976675840}]
I20260810 06:30:50.936458 2893 mvcc.cc:205] Tried to move back new op lower bound from 7316862774976675840 to 7316862774879092736. Current Snapshot: MvccSnapshot[applied={T|T < 7316862774976675840 or (T in {7316862774976675840})}]
I20260810 06:30:50.943604 2075 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:50.943794 2075 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:50.946517 2075 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: Sending DeleteTablet for 3 replicas of tablet 4c92a4f279ab4a9fa62d5df5c27354e1
I20260810 06:30:50.947492 2719 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c92a4f279ab4a9fa62d5df5c27354e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:50 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:54876
I20260810 06:30:50.947494 2497 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c92a4f279ab4a9fa62d5df5c27354e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:50 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:58060
I20260810 06:30:50.948221 2282 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c92a4f279ab4a9fa62d5df5c27354e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:50 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50196
I20260810 06:30:50.948474 2075 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 06:30:50.948772 2904 tablet_replica.cc:330] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: stopping tablet replica
W20260810 06:30:50.948959 2075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:50.948968 2905 tablet_replica.cc:330] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: stopping tablet replica
I20260810 06:30:50.949172 2904 raft_consensus.cc:2229] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:50.949561 2905 raft_consensus.cc:2229] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:50.949630 2904 raft_consensus.cc:2258] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:50.950145 2905 raft_consensus.cc:2258] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:50.950205 2903 tablet_replica.cc:330] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: stopping tablet replica
I20260810 06:30:50.950583 2903 raft_consensus.cc:2229] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:50.950917 2903 raft_consensus.cc:2258] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:50.952039 2905 ts_tablet_manager.cc:1905] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:50.952636 2903 ts_tablet_manager.cc:1905] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:50.955194 2905 ts_tablet_manager.cc:1918] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:50.955380 2905 log.cc:1196] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/4c92a4f279ab4a9fa62d5df5c27354e1
I20260810 06:30:50.955464 2282 tablet_service.cc:1467] Processing CreateTablet for tablet 62d648d59f924c65958fa29ca9d50170 (DEFAULT_TABLE table=test-table [id=5b9b2c7b10054b298f1c2cdb43be61fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:50.955631 2903 ts_tablet_manager.cc:1918] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:50.955736 2903 log.cc:1196] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/4c92a4f279ab4a9fa62d5df5c27354e1
I20260810 06:30:50.955770 2282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d648d59f924c65958fa29ca9d50170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:50.955987 2905 ts_tablet_manager.cc:1939] T 4c92a4f279ab4a9fa62d5df5c27354e1 P b876b6568d0d4473beb93cfd77be49f5: Deleting consensus metadata
I20260810 06:30:50.956146 2903 ts_tablet_manager.cc:1939] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 78e7ed68221f430293480ec0caeda67f: Deleting consensus metadata
I20260810 06:30:50.958087 2872 tablet_bootstrap.cc:492] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: Bootstrap starting.
I20260810 06:30:50.958335 2719 tablet_service.cc:1467] Processing CreateTablet for tablet 62d648d59f924c65958fa29ca9d50170 (DEFAULT_TABLE table=test-table [id=5b9b2c7b10054b298f1c2cdb43be61fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:50.958636 2719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d648d59f924c65958fa29ca9d50170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:50.959139 2872 tablet_bootstrap.cc:654] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:50.960528 2872 tablet_bootstrap.cc:492] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: No bootstrap required, opened a new log
I20260810 06:30:50.960623 2872 ts_tablet_manager.cc:1397] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:50.961057 2871 tablet_bootstrap.cc:492] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: Bootstrap starting.
I20260810 06:30:50.961097 2872 raft_consensus.cc:348] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.961207 2872 raft_consensus.cc:374] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:50.961236 2872 raft_consensus.cc:729] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Initialized, Role: FOLLOWER
I20260810 06:30:50.961337 2872 consensus_queue.cc:260] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.961431 2049 catalog_manager.cc:4841] TS 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411): tablet 4c92a4f279ab4a9fa62d5df5c27354e1 (table test-table [id=e744a9d121dc4f3c8d01d172dc3d0b29]) successfully deleted
I20260810 06:30:50.961689 2872 ts_tablet_manager.cc:1428] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:50.962092 2052 catalog_manager.cc:4841] TS b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193:38831): tablet 4c92a4f279ab4a9fa62d5df5c27354e1 (table test-table [id=e744a9d121dc4f3c8d01d172dc3d0b29]) successfully deleted
I20260810 06:30:50.962159 2871 tablet_bootstrap.cc:654] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:50.962131 2497 tablet_service.cc:1467] Processing CreateTablet for tablet 62d648d59f924c65958fa29ca9d50170 (DEFAULT_TABLE table=test-table [id=5b9b2c7b10054b298f1c2cdb43be61fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:50.962404 2497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 62d648d59f924c65958fa29ca9d50170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:50.964087 2871 tablet_bootstrap.cc:492] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: No bootstrap required, opened a new log
I20260810 06:30:50.964185 2871 ts_tablet_manager.cc:1397] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:50.964671 2871 raft_consensus.cc:348] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.964788 2871 raft_consensus.cc:374] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:50.964820 2871 raft_consensus.cc:729] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3243d44f81fb413e81f8a9d9873f9d12, State: Initialized, Role: FOLLOWER
I20260810 06:30:50.964928 2870 tablet_bootstrap.cc:492] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: Bootstrap starting.
I20260810 06:30:50.964952 2871 consensus_queue.cc:260] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.965221 2871 ts_tablet_manager.cc:1428] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:50.966014 2870 tablet_bootstrap.cc:654] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:50.968076 2904 ts_tablet_manager.cc:1905] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:50.970417 2870 tablet_bootstrap.cc:492] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: No bootstrap required, opened a new log
I20260810 06:30:50.970543 2870 ts_tablet_manager.cc:1397] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260810 06:30:50.971084 2904 ts_tablet_manager.cc:1918] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:50.971076 2870 raft_consensus.cc:348] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.971185 2904 log.cc:1196] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/4c92a4f279ab4a9fa62d5df5c27354e1
I20260810 06:30:50.971196 2870 raft_consensus.cc:374] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:50.971226 2870 raft_consensus.cc:729] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e7ed68221f430293480ec0caeda67f, State: Initialized, Role: FOLLOWER
I20260810 06:30:50.971351 2870 consensus_queue.cc:260] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:50.971526 2904 ts_tablet_manager.cc:1939] T 4c92a4f279ab4a9fa62d5df5c27354e1 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting consensus metadata
I20260810 06:30:50.971622 2870 ts_tablet_manager.cc:1428] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260810 06:30:50.973047 2052 catalog_manager.cc:4841] TS 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859): tablet 4c92a4f279ab4a9fa62d5df5c27354e1 (table test-table [id=e744a9d121dc4f3c8d01d172dc3d0b29]) successfully deleted
I20260810 06:30:51.274024 2880 raft_consensus.cc:482] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:51.274180 2880 raft_consensus.cc:504] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.274580 2880 leader_election.cc:288] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411), 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:51.275180 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d648d59f924c65958fa29ca9d50170" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f" is_pre_election: true
I20260810 06:30:51.275164 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d648d59f924c65958fa29ca9d50170" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3243d44f81fb413e81f8a9d9873f9d12" is_pre_election: true
I20260810 06:30:51.275333 2757 raft_consensus.cc:2454] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 0.
I20260810 06:30:51.275341 2529 raft_consensus.cc:2454] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 0.
I20260810 06:30:51.275703 2214 leader_election.cc:302] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3243d44f81fb413e81f8a9d9873f9d12, 78e7ed68221f430293480ec0caeda67f, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:51.275892 2880 raft_consensus.cc:2781] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:51.275957 2880 raft_consensus.cc:482] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:51.276000 2880 raft_consensus.cc:3037] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:51.277081 2880 raft_consensus.cc:504] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.277426 2880 leader_election.cc:288] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 election: Requested vote from peers 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411), 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:51.277899 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d648d59f924c65958fa29ca9d50170" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f"
I20260810 06:30:51.278028 2529 raft_consensus.cc:3037] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:51.279000 2529 raft_consensus.cc:2454] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 1.
I20260810 06:30:51.279295 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62d648d59f924c65958fa29ca9d50170" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3243d44f81fb413e81f8a9d9873f9d12"
I20260810 06:30:51.279435 2757 raft_consensus.cc:3037] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:51.279356 2211 leader_election.cc:302] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78e7ed68221f430293480ec0caeda67f, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:51.279668 2880 raft_consensus.cc:2781] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:51.279776 2880 raft_consensus.cc:686] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 1 LEADER]: Becoming Leader. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Running, Role: LEADER
I20260810 06:30:51.279929 2880 consensus_queue.cc:237] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.280682 2757 raft_consensus.cc:2454] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 1.
I20260810 06:30:51.281844 2075 catalog_manager.cc:5495] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } health_report { overall_health: UNKNOWN } } }
Aug 10 06:30:51 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343449, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.254@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:51.371898 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:51.363450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46231 (local address 127.0.0.1:44110)
0810 06:30:51.363818 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:51.363831 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:51.363951 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:51.364184 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:51.364186 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:51.364611 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:51.364709 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:51.364716 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.365423 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.365425 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:51.366048 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:51.366058 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.366531 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.366534 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:51.366592 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:51.367151 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:51.367163 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:51.368698 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:51.370453 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:51.370463 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:51.370470 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:51.370722 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:51.370941 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:51.370943 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:51.370944 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:51.371019 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:51.371382 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:51.371389 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:51.371512 (+ 123us) client_negotiation.cc:769] Sending connection context
0810 06:30:51.371604 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 06:30:51.371742 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":148,"threads_started":1}
I20260810 06:30:51.372002 2921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:51.363543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44110 (local address 127.21.195.254:46231)
0810 06:30:51.363912 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:51.363919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:51.363934 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:51.364036 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:51.364038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:51.364079 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:51.364155 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:51.364803 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.365338 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.366149 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.366430 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.366525 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:51.368840 (+ 2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:51.368843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:51.368845 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:51.368868 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:51.370367 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:51.370795 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:51.370798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:51.370799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:51.370876 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:51.371082 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:51.371084 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:51.371085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:51.371282 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:51.371358 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:51.371666 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 06:30:51.371820 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":311,"thread_start_us":90,"threads_started":1}
I20260810 06:30:51.376186 2075 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:44110:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 06:30:51.376988 2075 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:51.382131 2282 tablet_service.cc:1467] Processing CreateTablet for tablet a052be627c7a489dbf5785c53482ef35 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f5b3b6edc19444398b58bf7146881d09]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:51.382225 2719 tablet_service.cc:1467] Processing CreateTablet for tablet a052be627c7a489dbf5785c53482ef35 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f5b3b6edc19444398b58bf7146881d09]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:51.382225 2497 tablet_service.cc:1467] Processing CreateTablet for tablet a052be627c7a489dbf5785c53482ef35 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f5b3b6edc19444398b58bf7146881d09]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 06:30:51.382614 2282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a052be627c7a489dbf5785c53482ef35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:51.382614 2719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a052be627c7a489dbf5785c53482ef35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:51.382647 2497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a052be627c7a489dbf5785c53482ef35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:51.385315 2870 tablet_bootstrap.cc:492] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: Bootstrap starting.
I20260810 06:30:51.385547 2872 tablet_bootstrap.cc:492] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: Bootstrap starting.
I20260810 06:30:51.386014 2871 tablet_bootstrap.cc:492] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: Bootstrap starting.
I20260810 06:30:51.386242 2870 tablet_bootstrap.cc:654] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:51.386418 2872 tablet_bootstrap.cc:654] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:51.386945 2871 tablet_bootstrap.cc:654] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:51.387539 2870 tablet_bootstrap.cc:492] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: No bootstrap required, opened a new log
I20260810 06:30:51.387638 2870 ts_tablet_manager.cc:1397] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:30:51.388118 2870 raft_consensus.cc:348] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.388227 2870 raft_consensus.cc:374] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:51.388231 2872 tablet_bootstrap.cc:492] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: No bootstrap required, opened a new log
I20260810 06:30:51.388258 2870 raft_consensus.cc:729] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e7ed68221f430293480ec0caeda67f, State: Initialized, Role: FOLLOWER
I20260810 06:30:51.388317 2872 ts_tablet_manager.cc:1397] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:51.388394 2870 consensus_queue.cc:260] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.388679 2870 ts_tablet_manager.cc:1428] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 06:30:51.388670 2879 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.388746 2872 raft_consensus.cc:348] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.388846 2879 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:51.388857 2872 raft_consensus.cc:374] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:51.388888 2872 raft_consensus.cc:729] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Initialized, Role: FOLLOWER
I20260810 06:30:51.389008 2872 consensus_queue.cc:260] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.389267 2872 ts_tablet_manager.cc:1428] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:51.389398 2880 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.389509 2871 tablet_bootstrap.cc:492] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: No bootstrap required, opened a new log
I20260810 06:30:51.389577 2880 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:51.389624 2871 ts_tablet_manager.cc:1397] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 06:30:51.390094 2871 raft_consensus.cc:348] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.390201 2871 raft_consensus.cc:374] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:51.390230 2871 raft_consensus.cc:729] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3243d44f81fb413e81f8a9d9873f9d12, State: Initialized, Role: FOLLOWER
I20260810 06:30:51.390343 2871 consensus_queue.cc:260] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.390625 2871 ts_tablet_manager.cc:1428] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:51.390635 2881 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.390924 2881 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:51.702061 2880 consensus_queue.cc:1035] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:51.705920 2931 consensus_queue.cc:1035] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:51.741976 2931 raft_consensus.cc:482] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:51.742158 2931 raft_consensus.cc:504] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.742595 2931 leader_election.cc:288] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411), 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:51.743112 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a052be627c7a489dbf5785c53482ef35" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f" is_pre_election: true
I20260810 06:30:51.743114 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a052be627c7a489dbf5785c53482ef35" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3243d44f81fb413e81f8a9d9873f9d12" is_pre_election: true
I20260810 06:30:51.743265 2529 raft_consensus.cc:2454] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 0.
I20260810 06:30:51.743274 2757 raft_consensus.cc:2454] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 0.
I20260810 06:30:51.743587 2211 leader_election.cc:302] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78e7ed68221f430293480ec0caeda67f, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:51.743772 2931 raft_consensus.cc:2781] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:51.743839 2931 raft_consensus.cc:482] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:51.743885 2931 raft_consensus.cc:3037] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:51.745090 2931 raft_consensus.cc:504] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.745469 2931 leader_election.cc:288] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 election: Requested vote from peers 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411), 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:51.745915 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a052be627c7a489dbf5785c53482ef35" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f"
I20260810 06:30:51.745999 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a052be627c7a489dbf5785c53482ef35" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3243d44f81fb413e81f8a9d9873f9d12"
I20260810 06:30:51.746053 2529 raft_consensus.cc:3037] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:51.746134 2757 raft_consensus.cc:3037] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:51.747056 2757 raft_consensus.cc:2454] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 1.
I20260810 06:30:51.747071 2529 raft_consensus.cc:2454] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 1.
I20260810 06:30:51.747356 2211 leader_election.cc:302] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78e7ed68221f430293480ec0caeda67f, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:51.747550 2931 raft_consensus.cc:2781] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:51.747643 2931 raft_consensus.cc:686] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [term 1 LEADER]: Becoming Leader. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Running, Role: LEADER
I20260810 06:30:51.747812 2931 consensus_queue.cc:237] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.748524 2880 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: TxnStatusTablet state changed. Reason: New leader b876b6568d0d4473beb93cfd77be49f5. Latest consensus state: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.748646 2880 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:51.748894 2937 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 06:30:51.749063 2937 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 06:30:51.749645 2073 catalog_manager.cc:5495] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } health_report { overall_health: UNKNOWN } } }
I20260810 06:30:51.850006 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:51.846183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50214 (local address 127.21.195.193:38831)
0810 06:30:51.846513 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:51.846521 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:51.846532 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:30:51.846576 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:51.846578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:51.846620 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:51.846693 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:51.847019 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.847586 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.848494 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.848724 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.848833 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:51.849436 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:51.849564 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:51.849638 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:51.849764 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 06:30:51.849831 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":130,"threads_started":1}
I20260810 06:30:51.849990 2920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:51.846048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:38831 (local address 127.0.0.1:50214)
0810 06:30:51.846219 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:51.846236 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:51.846341 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:51.846739 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:51.846742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:51.846751 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:51.846861 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:51.846866 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.847744 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.847748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:51.848377 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:51.848386 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.848838 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.848841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:51.848941 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:51.848994 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:51.849654 (+ 660us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:51.849675 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 06:30:51.849739 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 06:30:51.849844 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 06:30:51.853103 2757 raft_consensus.cc:1261] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Refusing update from remote peer b876b6568d0d4473beb93cfd77be49f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:51.853166 2529 raft_consensus.cc:1261] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Refusing update from remote peer b876b6568d0d4473beb93cfd77be49f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:51.853703 2931 consensus_queue.cc:1035] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:51.853979 2880 consensus_queue.cc:1035] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:51.855381 2879 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: TxnStatusTablet state changed. Reason: New leader b876b6568d0d4473beb93cfd77be49f5. Latest consensus state: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.855515 2879 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:51.856149 2881 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: TxnStatusTablet state changed. Reason: New leader b876b6568d0d4473beb93cfd77be49f5. Latest consensus state: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.856295 2881 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:51.857661 2880 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.857796 2880 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:51.861011 2931 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.861145 2931 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P b876b6568d0d4473beb93cfd77be49f5: This TxnStatusTablet replica's current role is: LEADER
I20260810 06:30:51.861359 2879 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.861500 2879 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P 78e7ed68221f430293480ec0caeda67f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:51.862818 2881 tablet_replica.cc:439] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } } }
I20260810 06:30:51.862946 2881 tablet_replica.cc:442] T a052be627c7a489dbf5785c53482ef35 P 3243d44f81fb413e81f8a9d9873f9d12: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 06:30:51.875007 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:51.871066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:53797 (local address 127.21.195.193:38831)
0810 06:30:51.871189 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:51.871194 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:51.871414 (+ 220us) server_negotiation.cc:407] Connection header received
0810 06:30:51.871636 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:51.871639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:51.871729 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:51.871810 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:51.872074 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.872587 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.873835 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.874076 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.874158 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:51.874515 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:51.874593 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:51.874637 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:51.874750 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 06:30:51.874849 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":50}
I20260810 06:30:51.875058 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:51.870975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:38831 (local address 127.21.195.193:53797)
0810 06:30:51.871325 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:51.871341 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:51.871472 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:51.871826 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:51.871829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:51.871838 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:51.871980 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:51.871986 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.872693 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.872697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:51.873715 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:51.873728 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.874200 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.874205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:51.874298 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:51.874368 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:51.874663 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:51.874669 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:30:51.874740 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:30:51.874883 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":20,"thread_start_us":126,"threads_started":1}
I20260810 06:30:51.921990 2073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:51.922175 2073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:51.924309 2073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: Sending DeleteTablet for 3 replicas of tablet 62d648d59f924c65958fa29ca9d50170
I20260810 06:30:51.924988 2719 tablet_service.cc:1514] Processing DeleteTablet for tablet 62d648d59f924c65958fa29ca9d50170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:51 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:54876
I20260810 06:30:51.924961 2497 tablet_service.cc:1514] Processing DeleteTablet for tablet 62d648d59f924c65958fa29ca9d50170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:51 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:58060
I20260810 06:30:51.925040 2281 tablet_service.cc:1514] Processing DeleteTablet for tablet 62d648d59f924c65958fa29ca9d50170 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:51 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50196
I20260810 06:30:51.925382 2955 tablet_replica.cc:330] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: stopping tablet replica
I20260810 06:30:51.925559 2955 raft_consensus.cc:2229] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:51.925676 2956 tablet_replica.cc:330] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: stopping tablet replica
I20260810 06:30:51.925750 2955 raft_consensus.cc:2258] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:51.925800 2956 raft_consensus.cc:2229] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:51.925946 2954 tablet_replica.cc:330] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: stopping tablet replica
I20260810 06:30:51.926028 2956 raft_consensus.cc:2258] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:51.926162 2954 raft_consensus.cc:2229] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:51.926326 2954 raft_consensus.cc:2258] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:51.926721 2955 ts_tablet_manager.cc:1905] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:51.926905 2956 ts_tablet_manager.cc:1905] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:51.927186 2954 ts_tablet_manager.cc:1905] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:51.930043 2956 ts_tablet_manager.cc:1918] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:51.930043 2955 ts_tablet_manager.cc:1918] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:51.930138 2955 log.cc:1196] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/62d648d59f924c65958fa29ca9d50170
I20260810 06:30:51.930140 2956 log.cc:1196] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/62d648d59f924c65958fa29ca9d50170
I20260810 06:30:51.930409 2956 ts_tablet_manager.cc:1939] T 62d648d59f924c65958fa29ca9d50170 P b876b6568d0d4473beb93cfd77be49f5: Deleting consensus metadata
I20260810 06:30:51.930431 2955 ts_tablet_manager.cc:1939] T 62d648d59f924c65958fa29ca9d50170 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting consensus metadata
I20260810 06:30:51.930742 2954 ts_tablet_manager.cc:1918] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:51.930816 2954 log.cc:1196] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/62d648d59f924c65958fa29ca9d50170
I20260810 06:30:51.931028 2954 ts_tablet_manager.cc:1939] T 62d648d59f924c65958fa29ca9d50170 P 78e7ed68221f430293480ec0caeda67f: Deleting consensus metadata
I20260810 06:30:51.931257 2052 catalog_manager.cc:4841] TS 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859): tablet 62d648d59f924c65958fa29ca9d50170 (table test-table [id=5b9b2c7b10054b298f1c2cdb43be61fd]) successfully deleted
I20260810 06:30:51.931450 2052 catalog_manager.cc:4841] TS b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193:38831): tablet 62d648d59f924c65958fa29ca9d50170 (table test-table [id=5b9b2c7b10054b298f1c2cdb43be61fd]) successfully deleted
I20260810 06:30:51.931675 2049 catalog_manager.cc:4841] TS 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411): tablet 62d648d59f924c65958fa29ca9d50170 (table test-table [id=5b9b2c7b10054b298f1c2cdb43be61fd]) successfully deleted
Aug 10 06:30:51 dist-test-slave-7lbf krb5kdc[2000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 06:30:51 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:51 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 06:30:51.957409 2967 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:51.947999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44112 (local address 127.21.195.254:46231)
0810 06:30:51.948318 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:51.948323 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:51.948347 (+ 24us) server_negotiation.cc:407] Connection header received
0810 06:30:51.948533 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:51.948536 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:51.948585 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:51.948667 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:51.949460 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.950065 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.950962 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.951207 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.951315 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:51.957269 (+ 5954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44112: BlockingRecv error: recv got EOF from 127.0.0.1:44112 (error 108)
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":103,"threads_started":1}
Aug 10 06:30:51 dist-test-slave-7lbf krb5kdc[2000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM
I20260810 06:30:51.967279 2967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:51.959163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44118 (local address 127.21.195.254:46231)
0810 06:30:51.959307 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:51.959312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:51.959427 (+ 115us) server_negotiation.cc:407] Connection header received
0810 06:30:51.959571 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:51.959574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:51.959625 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:51.959697 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:51.960370 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.960922 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.961770 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:51.962023 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:51.962101 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:51.964401 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:51.964404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:51.964414 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:51.964446 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:51.965797 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:51.966207 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:51.966209 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:51.966211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:51.966296 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:51.966490 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:51.966492 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:51.966493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:51.966681 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:51.966785 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:51.966991 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 06:30:51.967106 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:30:51.969961 2073 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:51.970446 2073 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:51.975994 2281 tablet_service.cc:1467] Processing CreateTablet for tablet 96dba0432f1d403fba67372a63f21d57 (DEFAULT_TABLE table=test-table [id=6f318aad4c054346a7aceaa8c402ceb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:51.975994 2497 tablet_service.cc:1467] Processing CreateTablet for tablet 96dba0432f1d403fba67372a63f21d57 (DEFAULT_TABLE table=test-table [id=6f318aad4c054346a7aceaa8c402ceb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:51.976382 2497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96dba0432f1d403fba67372a63f21d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:51.976403 2281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96dba0432f1d403fba67372a63f21d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:51.978893 2976 tablet_bootstrap.cc:492] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: Bootstrap starting.
I20260810 06:30:51.979180 2719 tablet_service.cc:1467] Processing CreateTablet for tablet 96dba0432f1d403fba67372a63f21d57 (DEFAULT_TABLE table=test-table [id=6f318aad4c054346a7aceaa8c402ceb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:51.979523 2719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96dba0432f1d403fba67372a63f21d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:51.979872 2976 tablet_bootstrap.cc:654] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:51.981063 2976 tablet_bootstrap.cc:492] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: No bootstrap required, opened a new log
I20260810 06:30:51.981154 2976 ts_tablet_manager.cc:1397] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:30:51.981894 2977 tablet_bootstrap.cc:492] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: Bootstrap starting.
I20260810 06:30:51.981637 2976 raft_consensus.cc:348] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.982115 2976 raft_consensus.cc:374] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:51.982117 2981 tablet_bootstrap.cc:492] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: Bootstrap starting.
I20260810 06:30:51.982161 2976 raft_consensus.cc:729] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e7ed68221f430293480ec0caeda67f, State: Initialized, Role: FOLLOWER
I20260810 06:30:51.982326 2976 consensus_queue.cc:260] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.982997 2981 tablet_bootstrap.cc:654] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:51.983011 2977 tablet_bootstrap.cc:654] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:51.983325 2976 ts_tablet_manager.cc:1428] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:30:51.984405 2977 tablet_bootstrap.cc:492] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: No bootstrap required, opened a new log
I20260810 06:30:51.984511 2977 ts_tablet_manager.cc:1397] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:51.984903 2977 raft_consensus.cc:348] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.985026 2977 raft_consensus.cc:374] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:51.985061 2977 raft_consensus.cc:729] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Initialized, Role: FOLLOWER
I20260810 06:30:51.985186 2977 consensus_queue.cc:260] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.985466 2977 ts_tablet_manager.cc:1428] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 06:30:51.986415 2981 tablet_bootstrap.cc:492] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: No bootstrap required, opened a new log
I20260810 06:30:51.986514 2981 ts_tablet_manager.cc:1397] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 06:30:51.986954 2981 raft_consensus.cc:348] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.987082 2981 raft_consensus.cc:374] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:51.987124 2981 raft_consensus.cc:729] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3243d44f81fb413e81f8a9d9873f9d12, State: Initialized, Role: FOLLOWER
I20260810 06:30:51.987262 2981 consensus_queue.cc:260] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:51.987656 2981 ts_tablet_manager.cc:1428] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:30:52.125038 2931 raft_consensus.cc:482] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:52.125205 2931 raft_consensus.cc:504] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.125707 2931 leader_election.cc:288] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411), 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:52.126200 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96dba0432f1d403fba67372a63f21d57" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3243d44f81fb413e81f8a9d9873f9d12" is_pre_election: true
I20260810 06:30:52.126200 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96dba0432f1d403fba67372a63f21d57" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f" is_pre_election: true
I20260810 06:30:52.126358 2529 raft_consensus.cc:2454] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 0.
I20260810 06:30:52.126358 2757 raft_consensus.cc:2454] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 0.
I20260810 06:30:52.126706 2214 leader_election.cc:302] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3243d44f81fb413e81f8a9d9873f9d12, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:52.126984 2931 raft_consensus.cc:2781] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:52.127043 2931 raft_consensus.cc:482] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:52.127079 2931 raft_consensus.cc:3037] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:52.128425 2931 raft_consensus.cc:504] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.128832 2931 leader_election.cc:288] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 election: Requested vote from peers 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411), 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859)
I20260810 06:30:52.129202 2757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96dba0432f1d403fba67372a63f21d57" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3243d44f81fb413e81f8a9d9873f9d12"
I20260810 06:30:52.129213 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96dba0432f1d403fba67372a63f21d57" candidate_uuid: "b876b6568d0d4473beb93cfd77be49f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f"
I20260810 06:30:52.129340 2529 raft_consensus.cc:3037] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:52.129336 2757 raft_consensus.cc:3037] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:52.130448 2757 raft_consensus.cc:2454] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 1.
I20260810 06:30:52.130522 2529 raft_consensus.cc:2454] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b876b6568d0d4473beb93cfd77be49f5 in term 1.
I20260810 06:30:52.130793 2214 leader_election.cc:302] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3243d44f81fb413e81f8a9d9873f9d12, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:52.131013 2931 raft_consensus.cc:2781] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:52.131109 2931 raft_consensus.cc:686] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 1 LEADER]: Becoming Leader. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Running, Role: LEADER
I20260810 06:30:52.131259 2931 consensus_queue.cc:237] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.132934 2071 catalog_manager.cc:5495] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "b876b6568d0d4473beb93cfd77be49f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } health_report { overall_health: UNKNOWN } } }
I20260810 06:30:52.174611 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.171545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50216 (local address 127.21.195.193:38831)
0810 06:30:52.171667 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:52.171671 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:52.171685 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:30:52.171789 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:52.171792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:52.171848 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:52.171916 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:52.172111 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.172706 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.173616 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.173850 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.173937 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.174231 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:52.174309 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:52.174359 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:52.174427 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 06:30:52.174482 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:30:52.176723 2529 raft_consensus.cc:1261] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Refusing update from remote peer b876b6568d0d4473beb93cfd77be49f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:52.176723 2757 raft_consensus.cc:1261] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Refusing update from remote peer b876b6568d0d4473beb93cfd77be49f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:52.177193 2931 consensus_queue.cc:1035] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:52.177364 2880 consensus_queue.cc:1035] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:52.184896 2073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:52.185051 2073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:52.186936 2073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: Sending DeleteTablet for 3 replicas of tablet 96dba0432f1d403fba67372a63f21d57
I20260810 06:30:52.187455 2281 tablet_service.cc:1514] Processing DeleteTablet for tablet 96dba0432f1d403fba67372a63f21d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:52 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50196
I20260810 06:30:52.187590 2719 tablet_service.cc:1514] Processing DeleteTablet for tablet 96dba0432f1d403fba67372a63f21d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:52 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:54876
I20260810 06:30:52.187656 2956 tablet_replica.cc:330] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: stopping tablet replica
I20260810 06:30:52.187718 2497 tablet_service.cc:1514] Processing DeleteTablet for tablet 96dba0432f1d403fba67372a63f21d57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:52 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:58060
I20260810 06:30:52.187793 2956 raft_consensus.cc:2229] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:52.187805 2955 tablet_replica.cc:330] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: stopping tablet replica
I20260810 06:30:52.187882 2954 tablet_replica.cc:330] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: stopping tablet replica
I20260810 06:30:52.187925 2955 raft_consensus.cc:2229] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:52.187994 2954 raft_consensus.cc:2229] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:52.187997 2956 raft_consensus.cc:2258] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:52.188069 2955 raft_consensus.cc:2258] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:52.188122 2954 raft_consensus.cc:2258] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:52.188259 2071 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:30:52.188702 2071 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:30:52.188759 2956 ts_tablet_manager.cc:1905] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:52.188860 2955 ts_tablet_manager.cc:1905] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:52.190052 2954 ts_tablet_manager.cc:1905] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:52.191465 2955 ts_tablet_manager.cc:1918] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:52.191465 2956 ts_tablet_manager.cc:1918] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:52.191555 2955 log.cc:1196] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/96dba0432f1d403fba67372a63f21d57
I20260810 06:30:52.191555 2956 log.cc:1196] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/96dba0432f1d403fba67372a63f21d57
I20260810 06:30:52.191813 2955 ts_tablet_manager.cc:1939] T 96dba0432f1d403fba67372a63f21d57 P 3243d44f81fb413e81f8a9d9873f9d12: Deleting consensus metadata
I20260810 06:30:52.191813 2956 ts_tablet_manager.cc:1939] T 96dba0432f1d403fba67372a63f21d57 P b876b6568d0d4473beb93cfd77be49f5: Deleting consensus metadata
I20260810 06:30:52.192530 2052 catalog_manager.cc:4841] TS 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859): tablet 96dba0432f1d403fba67372a63f21d57 (table test-table [id=6f318aad4c054346a7aceaa8c402ceb9]) successfully deleted
I20260810 06:30:52.192737 2954 ts_tablet_manager.cc:1918] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:30:52.192823 2954 log.cc:1196] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/96dba0432f1d403fba67372a63f21d57
I20260810 06:30:52.192826 2052 catalog_manager.cc:4841] TS b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193:38831): tablet 96dba0432f1d403fba67372a63f21d57 (table test-table [id=6f318aad4c054346a7aceaa8c402ceb9]) successfully deleted
I20260810 06:30:52.193064 2954 ts_tablet_manager.cc:1939] T 96dba0432f1d403fba67372a63f21d57 P 78e7ed68221f430293480ec0caeda67f: Deleting consensus metadata
I20260810 06:30:52.193799 2049 catalog_manager.cc:4841] TS 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411): tablet 96dba0432f1d403fba67372a63f21d57 (table test-table [id=6f318aad4c054346a7aceaa8c402ceb9]) successfully deleted
I20260810 06:30:52.194826 2281 tablet_service.cc:1467] Processing CreateTablet for tablet dfe1cc68633e4acf993f759fba8ef82c (DEFAULT_TABLE table=test-table [id=757d65284f6847f59cd3942937d327c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:52.194870 2497 tablet_service.cc:1467] Processing CreateTablet for tablet dfe1cc68633e4acf993f759fba8ef82c (DEFAULT_TABLE table=test-table [id=757d65284f6847f59cd3942937d327c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:52.195127 2497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe1cc68633e4acf993f759fba8ef82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:52.195134 2281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe1cc68633e4acf993f759fba8ef82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:52.195163 2719 tablet_service.cc:1467] Processing CreateTablet for tablet dfe1cc68633e4acf993f759fba8ef82c (DEFAULT_TABLE table=test-table [id=757d65284f6847f59cd3942937d327c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:30:52.195407 2719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe1cc68633e4acf993f759fba8ef82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:52.197696 2977 tablet_bootstrap.cc:492] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5: Bootstrap starting.
I20260810 06:30:52.197693 2976 tablet_bootstrap.cc:492] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: Bootstrap starting.
I20260810 06:30:52.198587 2977 tablet_bootstrap.cc:654] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:52.198865 2976 tablet_bootstrap.cc:654] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:52.199671 2981 tablet_bootstrap.cc:492] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: Bootstrap starting.
I20260810 06:30:52.199769 2977 tablet_bootstrap.cc:492] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5: No bootstrap required, opened a new log
I20260810 06:30:52.199844 2977 ts_tablet_manager.cc:1397] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 06:30:52.200258 2977 raft_consensus.cc:348] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.200376 2977 raft_consensus.cc:374] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:52.200419 2977 raft_consensus.cc:729] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b876b6568d0d4473beb93cfd77be49f5, State: Initialized, Role: FOLLOWER
I20260810 06:30:52.200556 2977 consensus_queue.cc:260] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.200829 2977 ts_tablet_manager.cc:1428] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 06:30:52.200992 2981 tablet_bootstrap.cc:654] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:52.202073 2976 tablet_bootstrap.cc:492] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: No bootstrap required, opened a new log
I20260810 06:30:52.202171 2976 ts_tablet_manager.cc:1397] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 06:30:52.202297 2981 tablet_bootstrap.cc:492] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: No bootstrap required, opened a new log
I20260810 06:30:52.202399 2981 ts_tablet_manager.cc:1397] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 06:30:52.202674 2976 raft_consensus.cc:348] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.202811 2976 raft_consensus.cc:374] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:52.202857 2976 raft_consensus.cc:729] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e7ed68221f430293480ec0caeda67f, State: Initialized, Role: FOLLOWER
I20260810 06:30:52.202800 2981 raft_consensus.cc:348] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.202940 2981 raft_consensus.cc:374] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:52.202988 2981 raft_consensus.cc:729] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3243d44f81fb413e81f8a9d9873f9d12, State: Initialized, Role: FOLLOWER
I20260810 06:30:52.203025 2976 consensus_queue.cc:260] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.203122 2981 consensus_queue.cc:260] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.203337 2976 ts_tablet_manager.cc:1428] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260810 06:30:52.203860 2981 ts_tablet_manager.cc:1428] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:30:52.289734 2881 raft_consensus.cc:482] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:30:52.289940 2881 raft_consensus.cc:504] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.291214 2881 leader_election.cc:288] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193:38831), 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411)
I20260810 06:30:52.296861 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.291590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:42987 (local address 127.21.195.194:46411)
0810 06:30:52.291861 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:52.291873 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:52.292088 (+ 215us) server_negotiation.cc:407] Connection header received
0810 06:30:52.292188 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:52.292192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:52.292241 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:52.292325 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:52.292703 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.293560 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.295476 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.296138 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.296276 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.296337 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:52.296618 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 06:30:52.296701 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":102,"threads_started":1}
I20260810 06:30:52.296849 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.291617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:49971 (local address 127.21.195.193:38831)
0810 06:30:52.291771 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:52.291776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:52.291969 (+ 193us) server_negotiation.cc:407] Connection header received
0810 06:30:52.292155 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:52.292159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:52.292216 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:52.292299 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:30:52.292703 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.293561 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.295484 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.296136 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.296276 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.296337 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:52.296618 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 06:30:52.296702 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 06:30:52.296934 2995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.291479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:38831 (local address 127.21.195.195:49971)
0810 06:30:52.291866 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:52.291882 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:52.292018 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:52.292321 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:52.292324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:52.292379 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:52.292597 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:52.292603 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.293696 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.293700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:52.295319 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:52.295332 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.296284 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.296289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:52.296472 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.296515 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 06:30:52.296595 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 06:30:52.296730 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":248,"spinlock_wait_cycles":37632,"thread_start_us":116,"threads_started":1}
I20260810 06:30:52.297206 2996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.291483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46411 (local address 127.21.195.195:42987)
0810 06:30:52.291997 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:52.292010 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:52.292098 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:52.292331 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:52.292333 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:52.292372 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:30:52.292589 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:52.292598 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.293697 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.293700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:52.295319 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:52.295332 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.296284 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.296289 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:52.296467 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.296519 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 06:30:52.296595 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 06:30:52.296730 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":296,"spinlock_wait_cycles":2816,"thread_start_us":95,"threads_started":1}
I20260810 06:30:52.297744 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfe1cc68633e4acf993f759fba8ef82c" candidate_uuid: "3243d44f81fb413e81f8a9d9873f9d12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f" is_pre_election: true
I20260810 06:30:52.297798 2309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfe1cc68633e4acf993f759fba8ef82c" candidate_uuid: "3243d44f81fb413e81f8a9d9873f9d12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b876b6568d0d4473beb93cfd77be49f5" is_pre_election: true
I20260810 06:30:52.297921 2529 raft_consensus.cc:2454] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3243d44f81fb413e81f8a9d9873f9d12 in term 0.
I20260810 06:30:52.298069 2309 raft_consensus.cc:2454] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3243d44f81fb413e81f8a9d9873f9d12 in term 0.
I20260810 06:30:52.298344 2651 leader_election.cc:302] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3243d44f81fb413e81f8a9d9873f9d12, 78e7ed68221f430293480ec0caeda67f; no voters:
I20260810 06:30:52.298669 2881 raft_consensus.cc:2781] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:30:52.298728 2881 raft_consensus.cc:482] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:30:52.298753 2881 raft_consensus.cc:3037] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:52.299760 2881 raft_consensus.cc:504] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.300112 2881 leader_election.cc:288] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [CANDIDATE]: Term 1 election: Requested vote from peers b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193:38831), 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411)
I20260810 06:30:52.300559 2309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfe1cc68633e4acf993f759fba8ef82c" candidate_uuid: "3243d44f81fb413e81f8a9d9873f9d12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b876b6568d0d4473beb93cfd77be49f5"
I20260810 06:30:52.300558 2529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfe1cc68633e4acf993f759fba8ef82c" candidate_uuid: "3243d44f81fb413e81f8a9d9873f9d12" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e7ed68221f430293480ec0caeda67f"
I20260810 06:30:52.300691 2529 raft_consensus.cc:3037] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:52.300691 2309 raft_consensus.cc:3037] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:52.301903 2309 raft_consensus.cc:2454] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3243d44f81fb413e81f8a9d9873f9d12 in term 1.
I20260810 06:30:52.301903 2529 raft_consensus.cc:2454] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3243d44f81fb413e81f8a9d9873f9d12 in term 1.
I20260810 06:30:52.302251 2651 leader_election.cc:302] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3243d44f81fb413e81f8a9d9873f9d12, 78e7ed68221f430293480ec0caeda67f, b876b6568d0d4473beb93cfd77be49f5; no voters:
I20260810 06:30:52.302464 2881 raft_consensus.cc:2781] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:52.302685 2881 raft_consensus.cc:686] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 LEADER]: Becoming Leader. State: Replica: 3243d44f81fb413e81f8a9d9873f9d12, State: Running, Role: LEADER
I20260810 06:30:52.302961 2881 consensus_queue.cc:237] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } }
I20260810 06:30:52.305357 2073 catalog_manager.cc:5495] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195). New cstate: current_term: 1 leader_uuid: "3243d44f81fb413e81f8a9d9873f9d12" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3243d44f81fb413e81f8a9d9873f9d12" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 42859 } health_report { overall_health: HEALTHY } } }
I20260810 06:30:52.335333 3003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.331771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54892 (local address 127.21.195.195:42859)
0810 06:30:52.332066 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:52.332073 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:52.332087 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:30:52.332171 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:52.332173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:52.332230 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:52.332338 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:52.332518 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.333060 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.333905 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.334217 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.334302 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.334492 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:52.335011 (+ 519us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:52.335106 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:52.335132 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 06:30:52.335188 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":122,"threads_started":1}
I20260810 06:30:52.346819 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.343069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:59531 (local address 127.21.195.193:38831)
0810 06:30:52.343225 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:52.343230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:52.343324 (+ 94us) server_negotiation.cc:407] Connection header received
0810 06:30:52.343497 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:52.343501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:52.343553 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:52.343615 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:52.343876 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.344401 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.345676 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.345922 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.346041 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.346378 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:52.346467 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:52.346518 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:52.346615 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 06:30:52.346671 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:30:52.346875 3008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.342923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:38831 (local address 127.21.195.195:59531)
0810 06:30:52.343247 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:52.343262 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:52.343374 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:52.343639 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:52.343642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:52.343652 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:52.343773 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:52.343779 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.344517 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.344521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:52.345544 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:52.345558 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.346074 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.346079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:52.346181 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.346243 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:52.346539 (+ 296us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:52.346545 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 06:30:52.346602 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 06:30:52.346694 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":122,"threads_started":1}
I20260810 06:30:52.354244 2529 raft_consensus.cc:1261] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Refusing update from remote peer 3243d44f81fb413e81f8a9d9873f9d12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:52.354532 2309 raft_consensus.cc:1261] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Refusing update from remote peer 3243d44f81fb413e81f8a9d9873f9d12: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:30:52.354775 2999 consensus_queue.cc:1035] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78e7ed68221f430293480ec0caeda67f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:52.355046 2881 consensus_queue.cc:1035] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b876b6568d0d4473beb93cfd77be49f5" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 38831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:30:52.375645 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.371374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:42859 (local address 127.21.195.193:50187)
0810 06:30:52.371533 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:52.371568 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:52.371673 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:52.372135 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:52.372139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:52.372148 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 06:30:52.372266 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:52.372271 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.373332 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.373337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:52.374028 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:52.374038 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.374544 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.374548 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:52.374638 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.374669 (+ 31us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 06:30:52.375318 (+ 649us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 06:30:52.375325 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:30:52.375388 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 06:30:52.375495 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 06:30:52.375644 3003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.371714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:50187 (local address 127.21.195.195:42859)
0810 06:30:52.371892 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:52.371896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:52.371912 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:30:52.371960 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:52.371963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:52.372020 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:52.372099 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:30:52.372383 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.373203 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.374147 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:52.374436 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:52.374544 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:52.374779 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:30:52.374874 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:30:52.374944 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:52.375422 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 06:30:52.375498 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:30:52.410486 2073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:52.410687 2073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:30:52.413729 2073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1eda35f94e3f4e0c88b8406e7287edec: Sending DeleteTablet for 3 replicas of tablet dfe1cc68633e4acf993f759fba8ef82c
I20260810 06:30:52.414731 2497 tablet_service.cc:1514] Processing DeleteTablet for tablet dfe1cc68633e4acf993f759fba8ef82c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:52 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:58060
I20260810 06:30:52.414775 2719 tablet_service.cc:1514] Processing DeleteTablet for tablet dfe1cc68633e4acf993f759fba8ef82c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:52 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:54876
I20260810 06:30:52.414954 2954 tablet_replica.cc:330] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: stopping tablet replica
I20260810 06:30:52.414992 2955 tablet_replica.cc:330] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: stopping tablet replica
I20260810 06:30:52.415088 2954 raft_consensus.cc:2229] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:52.415117 2955 raft_consensus.cc:2229] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:30:52.415220 2954 raft_consensus.cc:2258] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:52.415499 2955 raft_consensus.cc:2258] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:52.415954 2281 tablet_service.cc:1514] Processing DeleteTablet for tablet dfe1cc68633e4acf993f759fba8ef82c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:30:52 UTC) from {username='oryx', principal='oryx/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50196
I20260810 06:30:52.416098 2954 ts_tablet_manager.cc:1905] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:52.416172 2956 tablet_replica.cc:330] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5: stopping tablet replica
I20260810 06:30:52.416285 2956 raft_consensus.cc:2229] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:30:52.416412 2956 raft_consensus.cc:2258] T dfe1cc68633e4acf993f759fba8ef82c P b876b6568d0d4473beb93cfd77be49f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:30:52.417048 2955 ts_tablet_manager.cc:1905] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:30:52.419482 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 2188
I20260810 06:30:52.419559 2955 ts_tablet_manager.cc:1918] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:52.422873 2955 log.cc:1196] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/dfe1cc68633e4acf993f759fba8ef82c
I20260810 06:30:52.423161 2955 ts_tablet_manager.cc:1939] T dfe1cc68633e4acf993f759fba8ef82c P 3243d44f81fb413e81f8a9d9873f9d12: Deleting consensus metadata
I20260810 06:30:52.424036 2052 catalog_manager.cc:4841] TS 3243d44f81fb413e81f8a9d9873f9d12 (127.21.195.195:42859): tablet dfe1cc68633e4acf993f759fba8ef82c (table test-table [id=757d65284f6847f59cd3942937d327c3]) successfully deleted
I20260810 06:30:52.434708 2954 ts_tablet_manager.cc:1918] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 06:30:52.434842 2954 log.cc:1196] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/dfe1cc68633e4acf993f759fba8ef82c
I20260810 06:30:52.435141 2954 ts_tablet_manager.cc:1939] T dfe1cc68633e4acf993f759fba8ef82c P 78e7ed68221f430293480ec0caeda67f: Deleting consensus metadata
I20260810 06:30:52.436080 2049 catalog_manager.cc:4841] TS 78e7ed68221f430293480ec0caeda67f (127.21.195.194:46411): tablet dfe1cc68633e4acf993f759fba8ef82c (table test-table [id=757d65284f6847f59cd3942937d327c3]) successfully deleted
W20260810 06:30:52.441780 2052 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:38831 (error 108)
I20260810 06:30:52.441932 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 2395
I20260810 06:30:52.455971 3018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:52.455393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:38831 (local address 127.0.0.1:50218)
0810 06:30:52.455703 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:52.455831 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:38831: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":83,"threads_started":1}
W20260810 06:30:52.456319 2052 catalog_manager.cc:4584] TS b876b6568d0d4473beb93cfd77be49f5 (127.21.195.193:38831): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dfe1cc68633e4acf993f759fba8ef82c: Network error: Client connection negotiation failed: client connection to 127.21.195.193:38831: connect: Connection refused (error 111)
I20260810 06:30:52.463959 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 2619
I20260810 06:30:52.487834 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 2019
2026-08-10T06:30:52Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4210 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:52 dist-test-slave-7lbf krb5kdc[3022](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:52 dist-test-slave-7lbf krb5kdc[3022](info): set up 2 sockets
Aug 10 06:30:52 dist-test-slave-7lbf krb5kdc[3022](info): commencing operation
krb5kdc: starting...
W20260810 06:30:53.674757 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:53 dist-test-slave-7lbf krb5kdc[3022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343453, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:53.806484 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36375
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:40201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:36375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:53.930734 3041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:53.931094 3041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:53.931136 3041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:53.935352 3041 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:53.935444 3041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:53.935464 3041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:53.935480 3041 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:53.935494 3041 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:53.941164 3041 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:40201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:36375
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:53.942457 3041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:53.943612 3041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:53.953142 3053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:53.953171 3050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:53.953223 3041 server_base.cc:1034] running on GCE node
W20260810 06:30:53.953171 3051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:53.954137 3041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:53.955358 3041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:53.956528 3041 hybrid_clock.cc:648] HybridClock initialized: now 1786343453956495 us; error 49 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T06:30:53Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1461 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:30:54 dist-test-slave-7lbf krb5kdc[3059](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:30:54 dist-test-slave-7lbf krb5kdc[3059](info): set up 2 sockets
Aug 10 06:30:54 dist-test-slave-7lbf krb5kdc[3059](info): commencing operation
krb5kdc: starting...
W20260810 06:30:55.137774 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:30:55 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:30:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:30:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:30:55.274746 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:34741
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:34741
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:55.398115 3075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:55.398456 3075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:55.398500 3075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:55.402786 3075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:55.402863 3075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:55.402882 3075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:55.402904 3075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:55.402932 3075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:55.408670 3075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:34741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:34741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:55.409970 3075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:55.411154 3075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:55.420560 3084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:55.420608 3075 server_base.cc:1034] running on GCE node
W20260810 06:30:55.420560 3088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:55.420560 3081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:55.421506 3075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:55.422857 3075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:55.424058 3075 hybrid_clock.cc:648] HybridClock initialized: now 1786343455424025 us; error 43 us; skew 500 ppm
Aug 10 06:30:55 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343455, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:55.427140 3075 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:55.428184 3075 webserver.cc:460] Webserver started at http://127.21.195.254:37579/ using document root <none> and password file <none>
I20260810 06:30:55.428802 3075 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:55.428876 3075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:55.429107 3075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:55.431495 3075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "8e4f41f607e545828387fe1a28a5cfee"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "4ee0d28447eca9ca4edef8c144791fca"
server_key_iv: "63ff78709e998dcdb401e56fb99a963c"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.432133 3075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "8e4f41f607e545828387fe1a28a5cfee"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "4ee0d28447eca9ca4edef8c144791fca"
server_key_iv: "63ff78709e998dcdb401e56fb99a963c"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.436439 3075 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 06:30:55.439307 3102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:55.440768 3075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:30:55.440923 3075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "8e4f41f607e545828387fe1a28a5cfee"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "4ee0d28447eca9ca4edef8c144791fca"
server_key_iv: "63ff78709e998dcdb401e56fb99a963c"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.441066 3075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:55.461676 3075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:55.465284 3075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:55.465502 3075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:55.473022 3075 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:34741
I20260810 06:30:55.473045 3184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:34741 every 8 connection(s)
I20260810 06:30:55.474150 3075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:55.477401 3185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:30:55.483122 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 3075
I20260810 06:30:55.483238 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:30:55.483528 22287 external_mini_cluster.cc:1428] Setting key 64caf8ae6dc683e064f4d2eb6e5335e0
I20260810 06:30:55.483937 3185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Bootstrap starting.
I20260810 06:30:55.486711 3185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Neither blocks nor log segments found. Creating new log.
I20260810 06:30:55.487726 3185 log.cc:824] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:55.490193 3185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: No bootstrap required, opened a new log
Aug 10 06:30:55 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:55.494772 3185 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } }
I20260810 06:30:55.495108 3185 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:30:55.495177 3185 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e4f41f607e545828387fe1a28a5cfee, State: Initialized, Role: FOLLOWER
I20260810 06:30:55.495668 3185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } }
I20260810 06:30:55.495797 3185 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:55.495844 3185 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:55.495950 3185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:30:55.497316 3185 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } }
I20260810 06:30:55.497747 3185 leader_election.cc:302] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e4f41f607e545828387fe1a28a5cfee; no voters:
I20260810 06:30:55.498142 3185 leader_election.cc:288] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:30:55.498236 3193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:30:55.498430 3193 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 1 LEADER]: Becoming Leader. State: Replica: 8e4f41f607e545828387fe1a28a5cfee, State: Running, Role: LEADER
I20260810 06:30:55.498835 3193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } }
I20260810 06:30:55.499492 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:55.485082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56838 (local address 127.21.195.254:34741)
0810 06:30:55.485613 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:55.485631 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:55.485672 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:30:55.486371 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:55.486391 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:55.486788 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:55.487132 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:55.488040 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:55.489249 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:55.490434 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:55.490963 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:55.491089 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:55.494014 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:55.494021 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:55.494039 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:55.494071 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:55.495887 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:55.496349 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:55.496357 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:55.496363 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:55.496531 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:55.496863 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:55.496866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:55.496868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:55.497458 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:55.497714 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:55.497996 (+ 282us) server_negotiation.cc:299] Negotiation successful
0810 06:30:55.498521 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":148,"threads_started":1}
I20260810 06:30:55.499641 3185 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:55.500728 3194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e4f41f607e545828387fe1a28a5cfee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } } }
I20260810 06:30:55.500873 3194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:55.501298 3195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e4f41f607e545828387fe1a28a5cfee. Latest consensus state: current_term: 1 leader_uuid: "8e4f41f607e545828387fe1a28a5cfee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } } }
I20260810 06:30:55.501391 3195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:55.502032 3208 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:55.505365 3208 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:55.512333 3208 catalog_manager.cc:1347] Generated new cluster ID: de366e7c2da949baa9217855914dd6c3
I20260810 06:30:55.512432 3208 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:55.520112 3208 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:30:55.521545 3208 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:55.547466 3208 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Generated new TSK 0
I20260810 06:30:55.548346 3208 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:30:55.582862 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34741
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:55.707306 3223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:55.707630 3223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:55.707676 3223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:55.711941 3223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:55.712028 3223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:55.712095 3223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:55.718223 3223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:55.719434 3223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:55.720595 3223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:55.731844 3232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:55.731870 3237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:55.731864 3233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:55.731930 3223 server_base.cc:1034] running on GCE node
I20260810 06:30:55.732635 3223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:55.733348 3223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:55.734527 3223 hybrid_clock.cc:648] HybridClock initialized: now 1786343455734502 us; error 43 us; skew 500 ppm
Aug 10 06:30:55 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343455, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:55.737633 3223 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:30:55.738659 3223 webserver.cc:460] Webserver started at http://127.21.195.193:38915/ using document root <none> and password file <none>
I20260810 06:30:55.739275 3223 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:55.739341 3223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:55.739533 3223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:55.741849 3223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "4c408318913e40d8b5041be838697660"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "7becc1e636bfb7602cc1c3b7e2218fcb"
server_key_iv: "f235b9a132d6fde32bbea0d2e4cdacc9"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.742437 3223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "4c408318913e40d8b5041be838697660"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "7becc1e636bfb7602cc1c3b7e2218fcb"
server_key_iv: "f235b9a132d6fde32bbea0d2e4cdacc9"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.746707 3223 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:30:55.749601 3249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:55.751037 3223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:55.751161 3223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "4c408318913e40d8b5041be838697660"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "7becc1e636bfb7602cc1c3b7e2218fcb"
server_key_iv: "f235b9a132d6fde32bbea0d2e4cdacc9"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.751271 3223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:55.766479 3223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:55.769968 3223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:55.770146 3223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:55.770818 3223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:55.771795 3223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:55.771852 3223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:55.771912 3223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:55.771939 3223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:55.781309 3223 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:36355
I20260810 06:30:55.781342 3417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:36355 every 8 connection(s)
I20260810 06:30:55.782406 3223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:55.791517 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 3223
I20260810 06:30:55.791672 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:30:55.792003 22287 external_mini_cluster.cc:1428] Setting key 51c6ebcc1c959d4a06ebe99dc80ba5e1
Aug 10 06:30:55 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343455, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:55.797380 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:55.784472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:34513 (local address 127.21.195.254:34741)
0810 06:30:55.784675 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:55.784679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:55.785647 (+ 968us) server_negotiation.cc:407] Connection header received
0810 06:30:55.787129 (+ 1482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:55.787132 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:55.787198 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:55.787275 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:55.788676 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:55.789242 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:55.790578 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:55.790822 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:55.790918 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:55.793792 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:55.793795 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:55.793798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:55.793826 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:55.795140 (+ 1314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:55.795705 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:55.795708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:55.795710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:55.795799 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:55.796161 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:55.796163 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:55.796164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:55.796367 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:55.796458 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:55.797052 (+ 594us) server_negotiation.cc:299] Negotiation successful
0810 06:30:55.797207 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260810 06:30:55.798314 3421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:55.784936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:34513)
0810 06:30:55.785448 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:55.785537 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:55.786878 (+ 1341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:55.787534 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:55.787543 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:55.787950 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:55.788505 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:55.788521 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:55.789382 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:55.789386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:55.790431 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:55.790443 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:55.790981 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:55.790986 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:55.791187 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:55.791891 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:55.791914 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:55.793603 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:55.795261 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:55.795267 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:55.795290 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:55.795593 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:55.795888 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:55.795891 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:55.795893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:55.796060 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:55.796478 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:55.796487 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:55.796780 (+ 293us) client_negotiation.cc:769] Sending connection context
0810 06:30:55.796964 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 06:30:55.797338 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":125,"threads_started":1}
I20260810 06:30:55.799669 3418 heartbeater.cc:347] Connected to a master server at 127.21.195.254:34741
I20260810 06:30:55.800047 3418 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:55.800801 3418 heartbeater.cc:511] Master 127.21.195.254:34741 requested a full tablet report, sending...
I20260810 06:30:55.802642 3131 ts_manager.cc:194] Registered new tserver with Master: 4c408318913e40d8b5041be838697660 (127.21.195.193:36355)
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:30:55.803937 3131 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:34513
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:30:55.822180 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34741
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:55.946741 3425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:55.947055 3425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:55.947101 3425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:55.951367 3425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:55.951449 3425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:55.951512 3425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:55.957197 3425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:55.958446 3425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:55.959553 3425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:55.970362 3438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:55.970424 3425 server_base.cc:1034] running on GCE node
W20260810 06:30:55.970373 3441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:55.970373 3435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:55.971170 3425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:55.971915 3425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:55.973093 3425 hybrid_clock.cc:648] HybridClock initialized: now 1786343455973073 us; error 29 us; skew 500 ppm
Aug 10 06:30:55 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343455, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:55.976068 3425 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:30:55.977118 3425 webserver.cc:460] Webserver started at http://127.21.195.194:40691/ using document root <none> and password file <none>
I20260810 06:30:55.977793 3425 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:55.977885 3425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:55.978119 3425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:55.980397 3425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "b54585528633416e8c7c072d73966267"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "04122547577b0967fe6d2282903cc5ae"
server_key_iv: "5f439fee42d117184ddfaa3bf21ac063"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.981000 3425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "b54585528633416e8c7c072d73966267"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "04122547577b0967fe6d2282903cc5ae"
server_key_iv: "5f439fee42d117184ddfaa3bf21ac063"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.985158 3425 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 06:30:55.987874 3452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:55.989234 3425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:55.989387 3425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "b54585528633416e8c7c072d73966267"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "04122547577b0967fe6d2282903cc5ae"
server_key_iv: "5f439fee42d117184ddfaa3bf21ac063"
server_key_version: "encryptionkey@0"
I20260810 06:30:55.989507 3425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:56.018497 3425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:56.022146 3425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:56.022354 3425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:56.023039 3425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:56.024015 3425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:56.024070 3425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.024127 3425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:56.024154 3425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.033412 3425 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:38207
I20260810 06:30:56.033447 3617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:38207 every 8 connection(s)
I20260810 06:30:56.034474 3425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:56.040477 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 3425
I20260810 06:30:56.040591 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:30:56.040874 22287 external_mini_cluster.cc:1428] Setting key 2e380f6d7d51234dd44708a8ba16ef84
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343455, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:56.050256 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:56.036582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:33179 (local address 127.21.195.254:34741)
0810 06:30:56.036739 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:56.036743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:56.037732 (+ 989us) server_negotiation.cc:407] Connection header received
0810 06:30:56.039182 (+ 1450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:56.039187 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:56.039249 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:56.039339 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:56.040719 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.041436 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.043041 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.043342 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.043459 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.046368 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:56.046372 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:56.046374 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:56.046404 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:56.047913 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:56.048479 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:56.048482 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:56.048484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:56.048575 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:56.048940 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:56.048944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:56.048946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:56.049194 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:56.049311 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:56.049925 (+ 614us) server_negotiation.cc:299] Negotiation successful
0810 06:30:56.050078 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 06:30:56.051226 3621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:56.037026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:33179)
0810 06:30:56.037572 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:56.037625 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:56.038941 (+ 1316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:56.039556 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:56.039563 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:56.039978 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:56.040515 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.040530 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.041612 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.041615 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.042900 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.042912 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.043491 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.043493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.043654 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.044268 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:56.044287 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:56.046143 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:56.048046 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:56.048053 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:56.048074 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:56.048374 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:56.048669 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:56.048672 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:56.048675 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:56.048846 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:56.049300 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:56.049307 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:56.049655 (+ 348us) client_negotiation.cc:769] Sending connection context
0810 06:30:56.049862 (+ 207us) client_negotiation.cc:240] Negotiation successful
0810 06:30:56.050248 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":131,"threads_started":1}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:30:56.052547 3618 heartbeater.cc:347] Connected to a master server at 127.21.195.254:34741
I20260810 06:30:56.052855 3618 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:56.053457 3618 heartbeater.cc:511] Master 127.21.195.254:34741 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:30:56.054841 3131 ts_manager.cc:194] Registered new tserver with Master: b54585528633416e8c7c072d73966267 (127.21.195.194:38207)
I20260810 06:30:56.055487 3131 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:33179
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:30:56.070673 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34741
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:56.197638 3628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:56.197973 3628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:56.198027 3628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:56.202493 3628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:56.202595 3628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:56.202693 3628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:56.208557 3628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:34741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:56.209936 3628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:56.211179 3628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:56.222018 3634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:56.222223 3628 server_base.cc:1034] running on GCE node
W20260810 06:30:56.222020 3636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:56.222020 3633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:56.222868 3628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:56.223592 3628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:56.224779 3628 hybrid_clock.cc:648] HybridClock initialized: now 1786343456224763 us; error 32 us; skew 500 ppm
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343456, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:56.227965 3628 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:30:56.229033 3628 webserver.cc:460] Webserver started at http://127.21.195.195:46657/ using document root <none> and password file <none>
I20260810 06:30:56.229722 3628 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:56.229815 3628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:56.230073 3628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:30:56.232491 3628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "5c5cc7c83e8f484e9411efe51c392944"
format_stamp: "Formatted at 2026-08-10 06:30:56 on dist-test-slave-7lbf"
server_key: "fe6fb9bbb7d1483b11ca14f30b2d63c3"
server_key_iv: "2396b8278f499ca24b900270eb57cadc"
server_key_version: "encryptionkey@0"
I20260810 06:30:56.233152 3628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "5c5cc7c83e8f484e9411efe51c392944"
format_stamp: "Formatted at 2026-08-10 06:30:56 on dist-test-slave-7lbf"
server_key: "fe6fb9bbb7d1483b11ca14f30b2d63c3"
server_key_iv: "2396b8278f499ca24b900270eb57cadc"
server_key_version: "encryptionkey@0"
I20260810 06:30:56.237696 3628 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.003s
I20260810 06:30:56.240516 3643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.241905 3628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:56.242039 3628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "5c5cc7c83e8f484e9411efe51c392944"
format_stamp: "Formatted at 2026-08-10 06:30:56 on dist-test-slave-7lbf"
server_key: "fe6fb9bbb7d1483b11ca14f30b2d63c3"
server_key_iv: "2396b8278f499ca24b900270eb57cadc"
server_key_version: "encryptionkey@0"
I20260810 06:30:56.242156 3628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:56.256203 3628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:56.259593 3628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:56.259804 3628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:56.260484 3628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:56.261458 3628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:56.261536 3628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.261605 3628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:56.261628 3628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.270668 3628 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:39645
I20260810 06:30:56.270699 3815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:39645 every 8 connection(s)
I20260810 06:30:56.271703 3628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:56.278972 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 3628
I20260810 06:30:56.279114 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:30:56.279393 22287 external_mini_cluster.cc:1428] Setting key d44593919dfb62113be03ed9210749e9
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343456, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:30:56.285866 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:56.273861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:60323 (local address 127.21.195.254:34741)
0810 06:30:56.274004 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:56.274008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:56.274956 (+ 948us) server_negotiation.cc:407] Connection header received
0810 06:30:56.276387 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:56.276391 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:56.276442 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:56.276518 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:56.277829 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.278386 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.279619 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.279893 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.280006 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.282604 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:56.282607 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:56.282610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:56.282638 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:56.283853 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:56.284356 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:56.284358 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:56.284359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:56.284440 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:56.284757 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:56.284761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:56.284762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:56.284981 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:56.285072 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:56.285602 (+ 530us) server_negotiation.cc:299] Negotiation successful
0810 06:30:56.285730 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:30:56.286839 3819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:56.274289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:60323)
0810 06:30:56.274793 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:56.274842 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:56.276155 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:56.276683 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:56.276690 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:56.277087 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:56.277680 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.277698 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.278487 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.278490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.279488 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.279503 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.280045 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.280049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.280266 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.280868 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:56.280889 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:56.282418 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:30:56.283966 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:56.283972 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:56.283987 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:56.284271 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:56.284505 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:30:56.284507 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:30:56.284509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:30:56.284648 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:30:56.285069 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:30:56.285074 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:30:56.285348 (+ 274us) client_negotiation.cc:769] Sending connection context
0810 06:30:56.285565 (+ 217us) client_negotiation.cc:240] Negotiation successful
0810 06:30:56.285877 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":140,"threads_started":1}
I20260810 06:30:56.288141 3816 heartbeater.cc:347] Connected to a master server at 127.21.195.254:34741
I20260810 06:30:56.288406 3816 heartbeater.cc:464] Registering TS with master...
I20260810 06:30:56.288971 3816 heartbeater.cc:511] Master 127.21.195.254:34741 requested a full tablet report, sending...
I20260810 06:30:56.290135 3131 ts_manager.cc:194] Registered new tserver with Master: 5c5cc7c83e8f484e9411efe51c392944 (127.21.195.195:39645)
I20260810 06:30:56.290747 3131 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:60323
I20260810 06:30:56.293486 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab.
Entry for principal oryx/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab.
WARNING: no policy specified for oryx/127.21.195.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab.
Entry for principal oryx/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab.
WARNING: no policy specified for oryx/127.21.195.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab.
Entry for principal oryx/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab.
I20260810 06:30:56.374737 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 3223
I20260810 06:30:56.395684 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 3425
I20260810 06:30:56.409142 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 3628
I20260810 06:30:56.425009 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 3075
I20260810 06:30:56.443513 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:34741
--webserver_interface=127.21.195.254
--webserver_port=37579
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:34741
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:30:56.565766 3828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:56.566085 3828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:56.566133 3828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:56.570339 3828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:30:56.570415 3828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:56.570442 3828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:56.570459 3828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:30:56.570490 3828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:30:56.576498 3828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:34741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:34741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=37579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:56.577845 3828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:56.579006 3828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:56.588454 3838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:56.588454 3840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:56.588454 3836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:56.588557 3828 server_base.cc:1034] running on GCE node
I20260810 06:30:56.589413 3828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:56.590761 3828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:56.591936 3828 hybrid_clock.cc:648] HybridClock initialized: now 1786343456591913 us; error 41 us; skew 500 ppm
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343456, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:56.595010 3828 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:30:56.596096 3828 webserver.cc:460] Webserver started at http://127.21.195.254:37579/ using document root <none> and password file <none>
I20260810 06:30:56.596709 3828 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:56.596810 3828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:56.601468 3828 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:56.603861 3849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.605268 3828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:56.605405 3828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "8e4f41f607e545828387fe1a28a5cfee"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "4ee0d28447eca9ca4edef8c144791fca"
server_key_iv: "63ff78709e998dcdb401e56fb99a963c"
server_key_version: "encryptionkey@0"
I20260810 06:30:56.606104 3828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:56.615761 3828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:56.619238 3828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:56.619446 3828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:56.626812 3828 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:34741
I20260810 06:30:56.626863 3946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:34741 every 8 connection(s)
I20260810 06:30:56.628036 3828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:30:56.630949 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 3828
I20260810 06:30:56.631386 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:36355
--local_ip_for_outbound_sockets=127.21.195.193
--tserver_master_addrs=127.21.195.254:34741
--webserver_port=38915
--webserver_interface=127.21.195.193
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.195.193
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:30:56.633293 3947 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:30:56.635789 3947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Bootstrap starting.
I20260810 06:30:56.659869 3947 log.cc:824] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Log is configured to *not* fsync() on all Append() calls
I20260810 06:30:56.669677 3947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:30:56.670094 3947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Bootstrap complete.
I20260810 06:30:56.674510 3947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } }
I20260810 06:30:56.674978 3947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e4f41f607e545828387fe1a28a5cfee, State: Initialized, Role: FOLLOWER
I20260810 06:30:56.675503 3947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } }
I20260810 06:30:56.675630 3947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:30:56.675702 3947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:30:56.675800 3947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:30:56.678061 3947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } }
I20260810 06:30:56.678418 3947 leader_election.cc:302] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e4f41f607e545828387fe1a28a5cfee; no voters:
I20260810 06:30:56.678776 3947 leader_election.cc:288] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 06:30:56.678931 3951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:30:56.679181 3951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [term 2 LEADER]: Becoming Leader. State: Replica: 8e4f41f607e545828387fe1a28a5cfee, State: Running, Role: LEADER
I20260810 06:30:56.679602 3951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } }
I20260810 06:30:56.680025 3947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:30:56.680729 3951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e4f41f607e545828387fe1a28a5cfee. Latest consensus state: current_term: 2 leader_uuid: "8e4f41f607e545828387fe1a28a5cfee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } } }
I20260810 06:30:56.680857 3951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:56.681254 3963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:30:56.681435 3954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8e4f41f607e545828387fe1a28a5cfee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e4f41f607e545828387fe1a28a5cfee" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 34741 } } }
I20260810 06:30:56.681665 3954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee [sys.catalog]: This master's current role is: LEADER
I20260810 06:30:56.684957 3963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:30:56.685721 3963 catalog_manager.cc:1259] Loaded cluster ID: de366e7c2da949baa9217855914dd6c3
I20260810 06:30:56.685792 3963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:30:56.688211 3963 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:30:56.688939 3963 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8e4f41f607e545828387fe1a28a5cfee: Loaded TSK: 0
I20260810 06:30:56.690264 3963 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:30:56.771806 3949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:56.772121 3949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:56.772168 3949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:56.776454 3949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:56.776536 3949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:56.776602 3949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:30:56.782433 3949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.193.keytab
--principal=oryx/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:36355
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=38915
--tserver_master_addrs=127.21.195.254:34741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:56.783641 3949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:56.784745 3949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:56.797760 3985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:56.797765 3986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:56.797998 3990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:56.799049 3949 server_base.cc:1034] running on GCE node
I20260810 06:30:56.799526 3949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:56.800285 3949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:56.801478 3949 hybrid_clock.cc:648] HybridClock initialized: now 1786343456801460 us; error 40 us; skew 500 ppm
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343456, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:56.804489 3949 init.cc:377] Logged in from keytab as oryx/127.21.195.193@KRBTEST.COM (short username oryx)
I20260810 06:30:56.805586 3949 webserver.cc:460] Webserver started at http://127.21.195.193:38915/ using document root <none> and password file <none>
I20260810 06:30:56.806214 3949 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:56.806305 3949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:56.810892 3949 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:30:56.813297 4000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.814755 3949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:56.814872 3949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "4c408318913e40d8b5041be838697660"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "7becc1e636bfb7602cc1c3b7e2218fcb"
server_key_iv: "f235b9a132d6fde32bbea0d2e4cdacc9"
server_key_version: "encryptionkey@0"
I20260810 06:30:56.815492 3949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:56.831394 3949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:56.835096 3949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:56.835300 3949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:56.836004 3949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:56.836949 3949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:56.837011 3949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.837065 3949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:56.837096 3949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:56.846556 3949 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:36355
I20260810 06:30:56.846580 4180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:36355 every 8 connection(s)
I20260810 06:30:56.847738 3949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:30:56.850663 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 3949
I20260810 06:30:56.851181 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:38207
--local_ip_for_outbound_sockets=127.21.195.194
--tserver_master_addrs=127.21.195.254:34741
--webserver_port=40691
--webserver_interface=127.21.195.194
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.195.194
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:56.862812 4189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:56.850225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:48975)
0810 06:30:56.850773 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:56.850837 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:56.852195 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:56.853743 (+ 1548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:56.853751 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:56.854138 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:56.854663 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.854678 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.856579 (+ 1901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.856582 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.857576 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.857588 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.858731 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.858734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.858893 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.859499 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:56.859517 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:56.861943 (+ 2426us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":165,"threads_started":1}
W20260810 06:30:56.863431 4182 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:34741 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.195.254:34741: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
W20260810 06:30:56.863669 4185 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:56.850046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:48975 (local address 127.21.195.254:34741)
0810 06:30:56.850543 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:56.850565 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:56.850961 (+ 396us) server_negotiation.cc:407] Connection header received
0810 06:30:56.852700 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:56.852720 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:56.853202 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:56.853636 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:56.854878 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.856432 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.857704 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.858565 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.858779 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.862280 (+ 3501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:48975: BlockingRecv error: recv got EOF from 127.21.195.193:48975 (error 108)
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":125,"threads_started":1}
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:56.869241 4189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:56.863892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:55247)
0810 06:30:56.864334 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:56.864353 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:56.864446 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:56.864695 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:56.864698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:56.864856 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:56.864955 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.864960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.865785 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.865787 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.866362 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.866373 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.866849 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.866853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.866946 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.867394 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:56.867406 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:56.869102 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110}
W20260810 06:30:56.869653 4192 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:56.864159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:55247 (local address 127.21.195.254:34741)
0810 06:30:56.864463 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:56.864472 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:56.864487 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:56.864541 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:56.864544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:56.864587 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:56.864662 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:56.865073 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.865672 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.866478 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.866729 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.866824 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.869261 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:55247: BlockingRecv error: recv got EOF from 127.21.195.193:55247 (error 108)
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":113,"threads_started":1}
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:56 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:56.875149 4189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:56.869827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:55829)
0810 06:30:56.870008 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:56.870021 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:56.870093 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:56.870315 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:56.870317 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:56.870455 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:56.870558 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.870563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.871592 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.871594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.872118 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:56.872126 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.872648 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.872650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:56.872708 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.873167 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:56.873179 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:56.875012 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109}
W20260810 06:30:56.875408 4192 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:56.869967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:55829 (local address 127.21.195.254:34741)
0810 06:30:56.870101 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:56.870106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:56.870121 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:56.870162 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:56.870165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:56.870211 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:56.870290 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:56.870653 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.871470 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.872221 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:56.872552 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:56.872655 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:56.875157 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:55829: BlockingRecv error: recv got EOF from 127.21.195.193:55829 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 06:30:56.875468 4182 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:30:56.977959 4190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:56.978276 4190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:56.978343 4190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:56.982728 4190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:56.982816 4190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:56.982903 4190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:30:56.988725 4190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.194.keytab
--principal=oryx/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:38207
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=40691
--tserver_master_addrs=127.21.195.254:34741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:56.990046 4190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:56.991232 4190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:57.002140 4204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:57.002251 4190 server_base.cc:1034] running on GCE node
W20260810 06:30:57.002140 4205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:57.002140 4208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:57.002863 4190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:57.003605 4190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:57.004771 4190 hybrid_clock.cc:648] HybridClock initialized: now 1786343457004747 us; error 35 us; skew 500 ppm
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343457, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:57.011034 4190 init.cc:377] Logged in from keytab as oryx/127.21.195.194@KRBTEST.COM (short username oryx)
I20260810 06:30:57.012167 4190 webserver.cc:460] Webserver started at http://127.21.195.194:40691/ using document root <none> and password file <none>
I20260810 06:30:57.012825 4190 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:57.012948 4190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:57.017477 4190 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:30:57.020004 4222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:57.021442 4190 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:30:57.021611 4190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "b54585528633416e8c7c072d73966267"
format_stamp: "Formatted at 2026-08-10 06:30:55 on dist-test-slave-7lbf"
server_key: "04122547577b0967fe6d2282903cc5ae"
server_key_iv: "5f439fee42d117184ddfaa3bf21ac063"
server_key_version: "encryptionkey@0"
I20260810 06:30:57.022346 4190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:57.040424 4190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:57.043936 4190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:57.044159 4190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:57.044855 4190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:57.045863 4190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:57.045917 4190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:57.045979 4190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:57.046006 4190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:57.055451 4190 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:38207
I20260810 06:30:57.055485 4395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:38207 every 8 connection(s)
I20260810 06:30:57.056612 4190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:30:57.059474 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 4190
I20260810 06:30:57.059914 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:39645
--local_ip_for_outbound_sockets=127.21.195.195
--tserver_master_addrs=127.21.195.254:34741
--webserver_port=46657
--webserver_interface=127.21.195.195
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.195.195
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 06:30:57.070885 4192 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:57.058759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:50555 (local address 127.21.195.254:34741)
0810 06:30:57.058920 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:57.058923 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:57.059905 (+ 982us) server_negotiation.cc:407] Connection header received
0810 06:30:57.061401 (+ 1496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:57.061406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:57.061479 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:57.061609 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:57.063402 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.064164 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.066087 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.066348 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.066443 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.070737 (+ 4294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:50555: BlockingRecv error: recv got EOF from 127.21.195.194:50555 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:30:57.071646 4400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:57.059181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:50555)
0810 06:30:57.059699 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:57.059757 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:57.061136 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:57.061868 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:57.061879 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:57.062425 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:57.063205 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.063230 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.064389 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.064392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.065929 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.065944 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.066537 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.066543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.066788 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.067513 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:57.067539 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:57.070551 (+ 3012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":127,"threads_started":1}
W20260810 06:30:57.072194 4398 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:34741 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.195.254:34741: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:57.078058 4400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:57.072746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:38585)
0810 06:30:57.072902 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:57.072918 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:57.073015 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:57.073269 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:57.073272 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:57.073439 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:57.073571 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.073579 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.074333 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.074336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.074903 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.074915 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.075361 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.075364 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.075455 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.075990 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:57.076002 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:57.077921 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260810 06:30:57.078207 4192 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:57.072823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:38585 (local address 127.21.195.254:34741)
0810 06:30:57.072941 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:57.072945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:57.072962 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:30:57.073114 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:57.073118 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:57.073169 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:57.073240 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:57.073696 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.074223 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.075030 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.075255 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.075358 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.078096 (+ 2738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:38585: BlockingRecv error: recv got EOF from 127.21.195.194:38585 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:57.084414 4400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:57.078878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:39041)
0810 06:30:57.079066 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:57.079080 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:57.079166 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:57.079396 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:57.079399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:57.079575 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:57.079678 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.079684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.080434 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.080437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.081386 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.081399 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.081835 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.081838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.081923 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.082361 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:57.082384 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:57.084262 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115}
W20260810 06:30:57.084645 4398 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:30:57.084805 4192 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:57.078967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:39041 (local address 127.21.195.254:34741)
0810 06:30:57.079075 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:57.079078 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:57.079122 (+ 44us) server_negotiation.cc:407] Connection header received
0810 06:30:57.079250 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:57.079253 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:57.079292 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:57.079358 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:57.079772 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.080337 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.081492 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.081735 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.081812 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.084434 (+ 2622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:39041: BlockingRecv error: recv got EOF from 127.21.195.194:39041 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260810 06:30:57.187634 4401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:30:57.187959 4401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:30:57.188014 4401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:30:57.192384 4401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:30:57.192462 4401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:30:57.192535 4401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:30:57.198297 4401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/krb5kdc/oryx_127.21.195.195.keytab
--principal=oryx/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:39645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=46657
--tserver_master_addrs=127.21.195.254:34741
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:30:57.199512 4401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:30:57.200644 4401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:30:57.211494 4416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:30:57.211557 4414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:57.211630 4401 server_base.cc:1034] running on GCE node
W20260810 06:30:57.211494 4413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:30:57.212257 4401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:30:57.213061 4401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:30:57.214221 4401 hybrid_clock.cc:648] HybridClock initialized: now 1786343457214183 us; error 53 us; skew 500 ppm
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343457, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:30:57.217280 4401 init.cc:377] Logged in from keytab as oryx/127.21.195.195@KRBTEST.COM (short username oryx)
I20260810 06:30:57.218489 4401 webserver.cc:460] Webserver started at http://127.21.195.195:46657/ using document root <none> and password file <none>
I20260810 06:30:57.219143 4401 fs_manager.cc:359] Metadata directory not provided
I20260810 06:30:57.219238 4401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:30:57.224046 4401 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 06:30:57.226653 4427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:57.228174 4401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 06:30:57.228329 4401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "5c5cc7c83e8f484e9411efe51c392944"
format_stamp: "Formatted at 2026-08-10 06:30:56 on dist-test-slave-7lbf"
server_key: "fe6fb9bbb7d1483b11ca14f30b2d63c3"
server_key_iv: "2396b8278f499ca24b900270eb57cadc"
server_key_version: "encryptionkey@0"
I20260810 06:30:57.228946 4401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:30:57.242695 4401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:30:57.245973 4401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:30:57.246176 4401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:30:57.246851 4401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:30:57.247808 4401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:30:57.247859 4401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:57.247918 4401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:30:57.247947 4401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:30:57.257308 4401 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:39645
I20260810 06:30:57.257339 4614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:39645 every 8 connection(s)
I20260810 06:30:57.258543 4401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:30:57.259163 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 4401
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:57.269783 4192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:57.259985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56852 (local address 127.21.195.254:34741)
0810 06:30:57.260136 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:57.260142 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:57.260392 (+ 250us) server_negotiation.cc:407] Connection header received
0810 06:30:57.260539 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:57.260542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:57.260585 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:57.260650 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:57.261555 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.262304 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.263577 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.263858 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.263946 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.265604 (+ 1658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:30:57.265611 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:30:57.265632 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:30:57.265667 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:30:57.267478 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:57.267947 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:57.267955 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:57.267961 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:57.268110 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:30:57.268412 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:30:57.268415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:30:57.268416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:30:57.268803 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:30:57.269029 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0810 06:30:57.269301 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 06:30:57.269604 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 06:30:57.271389 4185 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:57.260958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:57281 (local address 127.21.195.254:34741)
0810 06:30:57.261089 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:57.261093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:57.261874 (+ 781us) server_negotiation.cc:407] Connection header received
0810 06:30:57.263554 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:57.263557 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:57.263611 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:57.263673 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:57.265338 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.266095 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.267429 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.267732 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.267822 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.271279 (+ 3457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:57281: BlockingRecv error: recv got EOF from 127.21.195.195:57281 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:30:57.272140 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:57.261179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:57281)
0810 06:30:57.261728 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:57.261780 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:57.263319 (+ 1539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:57.263862 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:57.263871 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:57.264415 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:57.265167 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.265191 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.266234 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.266238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.267299 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.267311 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.267888 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.267893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.268071 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.268616 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:57.268634 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:57.271151 (+ 2517us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":131,"threads_started":1}
W20260810 06:30:57.272636 4615 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:34741 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.195.254:34741: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:57.277551 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:57.273044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:37893)
0810 06:30:57.273156 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:57.273171 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:57.273255 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:57.273448 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:57.273450 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:57.273630 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:57.273727 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.273733 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.274410 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.274412 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.274955 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.274962 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.275376 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.275378 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.275441 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.275852 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:57.275862 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:57.277409 (+ 1547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 06:30:57.277719 4185 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:57.273122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:37893 (local address 127.21.195.254:34741)
0810 06:30:57.273246 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:57.273249 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:57.273268 (+ 19us) server_negotiation.cc:407] Connection header received
0810 06:30:57.273326 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:57.273328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:57.273366 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:57.273426 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:57.273821 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.274330 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.275061 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.275289 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.275369 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.277589 (+ 2220us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:37893: BlockingRecv error: recv got EOF from 127.21.195.195:37893 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:57.283352 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:57.278096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:43261)
0810 06:30:57.278210 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:57.278224 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:57.278307 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:57.278514 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:57.278517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:57.278667 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:57.278742 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.278748 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.279442 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.279446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.280007 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.280015 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.280461 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.280464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.280534 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.280999 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:57.281012 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:57.283222 (+ 2210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 06:30:57.283632 4185 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:57.278174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:43261 (local address 127.21.195.254:34741)
0810 06:30:57.278326 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:57.278329 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:57.278344 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:57.278379 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:57.278382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:57.278420 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:57.278493 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:57.278847 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.279341 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.280114 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.280324 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.280430 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.283503 (+ 3073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:43261: BlockingRecv error: recv got EOF from 127.21.195.195:43261 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260810 06:30:57.283720 4615 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:57 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:57.881963 4621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:57.876093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:60117)
0810 06:30:57.876365 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:57.876380 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:57.876487 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:57.876721 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:57.876723 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:57.876924 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:57.877044 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.877050 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.877905 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.877909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.878535 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:57.878552 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.879066 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.879070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:57.879168 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.879706 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:57.879717 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:57.881802 (+ 2085us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":79,"threads_started":1}
W20260810 06:30:57.882077 4623 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:57.876227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:60117 (local address 127.21.195.254:34741)
0810 06:30:57.876463 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:57.876467 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:57.876482 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:57.876565 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:57.876567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:57.876612 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:57.876707 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:57.877171 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.877761 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.878684 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:57.878930 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:57.879025 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:57.881950 (+ 2925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:60117: BlockingRecv error: recv got EOF from 127.21.195.193:60117 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":67,"threads_started":1}
Aug 10 06:30:58 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:58 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:58.091656 4628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:58.085434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:36081)
0810 06:30:58.085781 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:58.085798 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:58.085960 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:58.086271 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:58.086275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:58.086485 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:58.086586 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:58.086593 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.087399 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.087403 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:58.088002 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:58.088012 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.088485 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.088489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:58.088576 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:58.089229 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:58.089242 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:58.091467 (+ 2225us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":119,"threads_started":1}
W20260810 06:30:58.091748 4623 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:58.085607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:36081 (local address 127.21.195.254:34741)
0810 06:30:58.085785 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:58.085790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:58.085875 (+ 85us) server_negotiation.cc:407] Connection header received
0810 06:30:58.086065 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:58.086068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:58.086119 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:58.086193 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:58.086730 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.087278 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.088131 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.088363 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.088466 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:58.091637 (+ 3171us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:36081: BlockingRecv error: recv got EOF from 127.21.195.194:36081 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 10 06:30:58 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:58 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:58.290066 4629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:58.284354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:49253)
0810 06:30:58.284616 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:58.284630 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:58.284737 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:58.284965 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:58.284967 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:58.285156 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:58.285260 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:58.285266 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.286026 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.286029 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:58.286637 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:58.286647 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.287191 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.287195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:58.287267 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:58.287765 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:58.287777 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:58.289879 (+ 2102us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":82,"threads_started":1}
W20260810 06:30:58.290144 4623 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:58.284424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:49253 (local address 127.21.195.254:34741)
0810 06:30:58.284608 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:58.284611 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:58.284698 (+ 87us) server_negotiation.cc:407] Connection header received
0810 06:30:58.284810 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:58.284813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:58.284864 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:58.284934 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:58.285360 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.285927 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.286806 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.287056 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.287152 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:58.290030 (+ 2878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:49253: BlockingRecv error: recv got EOF from 127.21.195.195:49253 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 10 06:30:58 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:58 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:58.888336 4630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:58.882865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:35427)
0810 06:30:58.883126 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:58.883140 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:58.883241 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:58.883549 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:58.883551 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:58.883799 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:58.883925 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:58.883942 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.884697 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.884700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:58.885272 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:58.885289 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.885689 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.885692 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:58.885756 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:58.886231 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:58.886242 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:58.888178 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":78,"threads_started":1}
W20260810 06:30:58.888541 4631 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:58.882897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:35427 (local address 127.21.195.254:34741)
0810 06:30:58.883166 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:58.883170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:58.883188 (+ 18us) server_negotiation.cc:407] Connection header received
0810 06:30:58.883347 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:58.883350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:58.883397 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:58.883495 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:58.884054 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.884597 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.885367 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:58.885610 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:58.885682 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:58.888399 (+ 2717us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:35427: BlockingRecv error: recv got EOF from 127.21.195.193:35427 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":71,"threads_started":1}
Aug 10 06:30:59 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:59 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:59.098629 4633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:59.092769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:48601)
0810 06:30:59.093080 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:59.093095 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:59.093212 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:59.093470 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:59.093472 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:59.093687 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:59.093792 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:59.093798 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.094638 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.094641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:59.095241 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:59.095252 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.095822 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.095826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:59.095909 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:59.096448 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:59.096462 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:59.098468 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":91,"threads_started":1}
W20260810 06:30:59.098790 4631 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:59.092900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:48601 (local address 127.21.195.254:34741)
0810 06:30:59.093093 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:59.093097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:59.093173 (+ 76us) server_negotiation.cc:407] Connection header received
0810 06:30:59.093295 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:59.093297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:59.093353 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:59.093434 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:59.093939 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.094503 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.095380 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.095637 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.095748 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:59.098638 (+ 2890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:48601: BlockingRecv error: recv got EOF from 127.21.195.194:48601 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 10 06:30:59 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:59 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:59.296927 4635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:59.290992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:47409)
0810 06:30:59.291280 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:59.291294 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:59.291416 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:59.291706 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:59.291710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:59.291926 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:59.292036 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:59.292043 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.292769 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.292771 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:59.293359 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:59.293367 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.293977 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.293981 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:59.294074 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:59.294683 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:59.294701 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:59.296749 (+ 2048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":86,"threads_started":1}
W20260810 06:30:59.297037 4631 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:59.291142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:47409 (local address 127.21.195.254:34741)
0810 06:30:59.291273 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:59.291277 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:59.291359 (+ 82us) server_negotiation.cc:407] Connection header received
0810 06:30:59.291496 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:59.291499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:59.291549 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:59.291630 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:59.292140 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.292671 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.293448 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.293724 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.293795 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:59.296904 (+ 3109us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:47409: BlockingRecv error: recv got EOF from 127.21.195.195:47409 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 10 06:30:59 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:30:59 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:30:59.894711 4637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:30:59.889191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:36707)
0810 06:30:59.889535 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0810 06:30:59.889551 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:30:59.889656 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:30:59.889923 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:30:59.889925 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:30:59.890120 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:30:59.890226 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:59.890231 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.890977 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.890978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:59.891569 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:30:59.891577 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.891981 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.891984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:30:59.892044 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:59.892543 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:30:59.892553 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:30:59.894576 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":101,"threads_started":1}
W20260810 06:30:59.894976 4639 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:30:59.889348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:36707 (local address 127.21.195.254:34741)
0810 06:30:59.889616 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0810 06:30:59.889620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:30:59.889635 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:30:59.889743 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:30:59.889746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:30:59.889791 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:30:59.889882 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:30:59.890326 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.890891 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.891663 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:30:59.891895 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:30:59.891966 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:30:59.894814 (+ 2848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:36707: BlockingRecv error: recv got EOF from 127.21.195.193:36707 (error 108)
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":71,"threads_started":1}
Aug 10 06:31:00 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:00 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:00.105384 4641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:00.099682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:48619)
0810 06:31:00.099969 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:00.099984 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:00.100092 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:00.100325 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:00.100327 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:00.100526 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:00.100631 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:00.100637 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.101362 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.101365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:00.101980 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:00.101991 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.102482 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.102484 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:00.102554 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:00.103063 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:00.103076 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:00.105184 (+ 2108us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":80,"threads_started":1}
W20260810 06:31:00.105621 4639 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:00.099823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:48619 (local address 127.21.195.254:34741)
0810 06:31:00.099966 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:00.099970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:00.100054 (+ 84us) server_negotiation.cc:407] Connection header received
0810 06:31:00.100170 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:00.100173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:00.100218 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:00.100297 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:00.100729 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.101255 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.102108 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.102349 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.102455 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:00.105463 (+ 3008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:48619: BlockingRecv error: recv got EOF from 127.21.195.194:48619 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 06:31:00 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:00 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:00.303678 4642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:00.297833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:33649)
0810 06:31:00.298370 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:00.298385 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:00.298507 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:00.298818 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:00.298821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:00.299035 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:00.299147 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:00.299155 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.299898 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.299901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:00.300466 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:00.300473 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.300951 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.300954 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:00.301022 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:00.301552 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:00.301570 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:00.303525 (+ 1955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":82,"threads_started":1}
W20260810 06:31:00.303853 4639 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:00.297919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:33649 (local address 127.21.195.254:34741)
0810 06:31:00.298070 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:00.298075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:00.298474 (+ 399us) server_negotiation.cc:407] Connection header received
0810 06:31:00.298616 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:00.298618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:00.298673 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:00.298762 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:00.299260 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.299797 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.300582 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.300823 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.300905 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:00.303713 (+ 2808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:33649: BlockingRecv error: recv got EOF from 127.21.195.195:33649 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 10 06:31:00 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:00 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:00.901611 4643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:00.895695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:43535)
0810 06:31:00.896028 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:00.896043 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:00.896146 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:00.896379 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:00.896381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:00.896571 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:00.896678 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:00.896683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.897546 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.897550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:00.898122 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:00.898131 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.898601 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.898604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:00.898685 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:00.899320 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:00.899342 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:00.901443 (+ 2101us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":101,"threads_started":1}
W20260810 06:31:00.901772 4645 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:00.895889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:43535 (local address 127.21.195.254:34741)
0810 06:31:00.896137 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:00.896141 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:00.896156 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:31:00.896220 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:00.896222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:00.896264 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:00.896352 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:00.896826 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.897396 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.898221 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:00.898466 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:00.898549 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:00.901624 (+ 3075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:43535: BlockingRecv error: recv got EOF from 127.21.195.193:43535 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":72,"threads_started":1}
Aug 10 06:31:01 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:01 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:01.112025 4647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:01.106215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:57757)
0810 06:31:01.106522 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:01.106537 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:01.106656 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:01.106942 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:01.106945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:01.107165 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:01.107269 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:01.107276 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.108076 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.108080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:01.108645 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:01.108654 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.109145 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.109149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:01.109241 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:01.109785 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:01.109798 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:01.111888 (+ 2090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":130,"threads_started":1}
W20260810 06:31:01.112181 4645 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:01.106321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:57757 (local address 127.21.195.254:34741)
0810 06:31:01.106502 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:01.106507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:01.106610 (+ 103us) server_negotiation.cc:407] Connection header received
0810 06:31:01.106751 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:01.106754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:01.106806 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:01.106878 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:01.107418 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.107958 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.108768 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.109024 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.109124 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:01.112048 (+ 2924us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:57757: BlockingRecv error: recv got EOF from 127.21.195.194:57757 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 06:31:01 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:01 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:01.310717 4648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:01.304695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:60045)
0810 06:31:01.305116 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:01.305135 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:01.305265 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:01.305583 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:01.305586 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:01.305800 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:01.305904 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:01.305911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.306707 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.306710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:01.307275 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:01.307284 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.307761 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.307765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:01.307851 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:01.308400 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:01.308412 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:01.310556 (+ 2144us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":134,"threads_started":1}
W20260810 06:31:01.310839 4645 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:01.304833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:60045 (local address 127.21.195.254:34741)
0810 06:31:01.305027 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:01.305032 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:01.305218 (+ 186us) server_negotiation.cc:407] Connection header received
0810 06:31:01.305378 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:01.305382 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:01.305434 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:01.305505 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:01.306045 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.306582 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.307412 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.307645 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.307739 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:01.310716 (+ 2977us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:60045: BlockingRecv error: recv got EOF from 127.21.195.195:60045 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 10 06:31:01 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:01 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:01.908022 4650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:01.902545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:55601)
0810 06:31:01.902864 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:01.902877 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:01.902966 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:01.903206 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:01.903208 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:01.903411 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:01.903517 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:01.903522 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.904267 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.904269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:01.904866 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:01.904877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.905319 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.905322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:01.905397 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:01.905935 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:01.905947 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:01.907881 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":112,"threads_started":1}
W20260810 06:31:01.908232 4651 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:01.902689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:55601 (local address 127.21.195.254:34741)
0810 06:31:01.902932 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:01.902935 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:01.902950 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:31:01.903048 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:01.903050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:01.903093 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:01.903178 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:01.903610 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.904154 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.904977 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:01.905216 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:01.905296 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:01.908087 (+ 2791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:55601: BlockingRecv error: recv got EOF from 127.21.195.193:55601 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":67,"threads_started":1}
Aug 10 06:31:02 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:02 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:02.122195 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:02.113041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:53491)
0810 06:31:02.113380 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:02.113398 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:02.113558 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:02.113868 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:02.113872 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:02.114108 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:02.114213 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:02.114221 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.115155 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.115159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:02.115817 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:02.115830 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.116262 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.116265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:02.116333 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:02.119731 (+ 3398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:02.119747 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:02.122031 (+ 2284us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":84,"threads_started":1}
W20260810 06:31:02.122407 4651 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:02.113273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:53491 (local address 127.21.195.254:34741)
0810 06:31:02.113431 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:02.113436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:02.113455 (+ 19us) server_negotiation.cc:407] Connection header received
0810 06:31:02.113663 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:02.113667 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:02.113721 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:02.113803 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:02.114343 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.115007 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.115939 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.116157 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.116223 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:02.122262 (+ 6039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:53491: BlockingRecv error: recv got EOF from 127.21.195.194:53491 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 06:31:02 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:02 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:02.317626 4656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:02.311716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:39225)
0810 06:31:02.312050 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:02.312065 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:02.312188 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:02.312456 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:02.312459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:02.312687 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:02.312787 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:02.312793 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.313603 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.313607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:02.314215 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:02.314225 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.314707 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.314712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:02.314802 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:02.315332 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:02.315345 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:02.317423 (+ 2078us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":103,"threads_started":1}
W20260810 06:31:02.317765 4651 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:02.311839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:39225 (local address 127.21.195.254:34741)
0810 06:31:02.311990 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:02.311995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:02.312143 (+ 148us) server_negotiation.cc:407] Connection header received
0810 06:31:02.312284 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:02.312287 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:02.312341 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:02.312421 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:02.312912 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.313458 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.314337 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.314592 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.314686 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:02.317645 (+ 2959us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:39225: BlockingRecv error: recv got EOF from 127.21.195.195:39225 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 06:31:02 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:02 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:02.914505 4658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:02.908827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:42439)
0810 06:31:02.909122 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:02.909137 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:02.909235 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:02.909497 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:02.909499 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:02.909740 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:02.909850 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:02.909857 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.910825 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.910827 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:02.911407 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:02.911416 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.911820 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.911822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:02.911883 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:02.912390 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:02.912402 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:02.914352 (+ 1950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":83,"threads_started":1}
W20260810 06:31:02.914667 4659 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:02.908932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:42439 (local address 127.21.195.254:34741)
0810 06:31:02.909224 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:02.909227 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:02.909241 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:31:02.909318 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:02.909321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:02.909371 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:02.909467 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:02.910034 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.910717 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.911504 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:02.911733 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:02.911807 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:02.914532 (+ 2725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:42439: BlockingRecv error: recv got EOF from 127.21.195.193:42439 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":121,"threads_started":1}
Aug 10 06:31:03 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:03 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:03.128756 4663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:03.123175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:40467)
0810 06:31:03.123492 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:03.123506 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:03.123619 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:03.123838 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:03.123841 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:03.124052 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:03.124153 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:03.124160 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.124899 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.124913 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:03.125489 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:03.125499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.126026 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.126031 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:03.126114 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:03.126613 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:03.126626 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:03.128621 (+ 1995us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":113,"threads_started":1}
W20260810 06:31:03.128983 4659 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:03.123240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:40467 (local address 127.21.195.254:34741)
0810 06:31:03.123406 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:03.123411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:03.123576 (+ 165us) server_negotiation.cc:407] Connection header received
0810 06:31:03.123693 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:03.123696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:03.123744 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:03.123815 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:03.124248 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.124782 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.125666 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.125910 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.126007 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:03.128845 (+ 2838us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:40467: BlockingRecv error: recv got EOF from 127.21.195.194:40467 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 10 06:31:03 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:03 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:03.326617 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:03.320615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:58455)
0810 06:31:03.320948 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:03.320964 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:03.321092 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:03.321395 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:03.321398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:03.321657 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:03.321760 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:03.321767 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.322592 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.322595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:03.323168 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:03.323177 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.323650 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.323654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:03.323756 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:03.324278 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:03.324291 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:03.326428 (+ 2137us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":125,"threads_started":1}
W20260810 06:31:03.326754 4659 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:03.320842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:58455 (local address 127.21.195.254:34741)
0810 06:31:03.320984 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:03.320988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:03.321063 (+ 75us) server_negotiation.cc:407] Connection header received
0810 06:31:03.321196 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:03.321199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:03.321253 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:03.321320 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:03.321892 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.322458 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.323292 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.323525 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.323620 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:03.326622 (+ 3002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:58455: BlockingRecv error: recv got EOF from 127.21.195.195:58455 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 06:31:03 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:03 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:03.920854 4666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:03.915358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:38647)
0810 06:31:03.915673 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:03.915687 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:03.915789 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:03.916014 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:03.916016 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:03.916201 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:03.916301 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:03.916306 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.917016 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.917018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:03.917629 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:03.917639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.918019 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.918022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:03.918083 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:03.918649 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:03.918662 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:03.920683 (+ 2021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":79,"threads_started":1}
W20260810 06:31:03.921005 4667 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:03.915421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:38647 (local address 127.21.195.254:34741)
0810 06:31:03.915663 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:03.915667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:03.915739 (+ 72us) server_negotiation.cc:407] Connection header received
0810 06:31:03.915861 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:03.915864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:03.915908 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:03.915990 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:03.916387 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.916932 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.917716 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:03.917938 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:03.918008 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:03.920877 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:38647: BlockingRecv error: recv got EOF from 127.21.195.193:38647 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":74,"threads_started":1}
Aug 10 06:31:04 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:04 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:04.135324 4668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:04.129675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:45761)
0810 06:31:04.130033 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:04.130047 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:04.130168 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:04.130457 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:04.130461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:04.130738 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:04.130852 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:04.130860 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.131649 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.131652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:04.132250 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:04.132260 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.132690 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.132694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:04.132778 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:04.133321 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:04.133333 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:04.135198 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":91,"threads_started":1}
W20260810 06:31:04.135504 4667 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:04.129742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:45761 (local address 127.21.195.254:34741)
0810 06:31:04.129891 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:04.129895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:04.130129 (+ 234us) server_negotiation.cc:407] Connection header received
0810 06:31:04.130261 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:04.130264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:04.130321 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:04.130415 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:04.130994 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.131543 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.132359 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.132599 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.132681 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:04.135355 (+ 2674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:45761: BlockingRecv error: recv got EOF from 127.21.195.194:45761 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 06:31:04 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:04 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:04.333561 4671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:04.327605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:51867)
0810 06:31:04.327978 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:04.327994 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:04.328122 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:04.328398 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:04.328401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:04.328632 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:04.328732 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:04.328738 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.329559 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.329563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:04.330131 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:04.330141 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.330615 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.330619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:04.330708 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:04.331227 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:04.331239 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:04.333367 (+ 2128us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":94,"threads_started":1}
W20260810 06:31:04.333719 4667 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:04.327689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:51867 (local address 127.21.195.254:34741)
0810 06:31:04.327835 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:04.327840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:04.328076 (+ 236us) server_negotiation.cc:407] Connection header received
0810 06:31:04.328222 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:04.328225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:04.328283 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:04.328356 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:04.328861 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.329410 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.330252 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.330483 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.330594 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:04.333596 (+ 3002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:51867: BlockingRecv error: recv got EOF from 127.21.195.195:51867 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 06:31:04 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:04 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:04.927858 4672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:04.921846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:48063)
0810 06:31:04.922168 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:04.922185 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:04.922307 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:04.922672 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:04.922675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:04.922921 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:04.923036 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:04.923043 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.923962 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.923965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:04.924548 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:04.924556 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.925028 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.925031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:04.925100 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:04.925677 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:04.925693 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:04.927674 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":103,"threads_started":1}
W20260810 06:31:04.928004 4673 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:04.922112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:48063 (local address 127.21.195.254:34741)
0810 06:31:04.922392 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:04.922397 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:04.922410 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:31:04.922451 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:04.922454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:04.922510 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:04.922614 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:04.923167 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.923856 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.924654 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:04.924903 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:04.925013 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:04.927877 (+ 2864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:48063: BlockingRecv error: recv got EOF from 127.21.195.193:48063 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":79,"threads_started":1}
Aug 10 06:31:05 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:05 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:05.141904 4674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:05.136138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:39821)
0810 06:31:05.136432 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:05.136446 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:05.136558 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:05.136786 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:05.136788 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:05.136987 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:05.137127 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:05.137133 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.138044 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.138047 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:05.138641 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:05.138652 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.139062 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.139064 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:05.139133 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:05.139666 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:05.139679 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:05.141746 (+ 2067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":76,"threads_started":1}
W20260810 06:31:05.142127 4673 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:05.136294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:39821 (local address 127.21.195.254:34741)
0810 06:31:05.136442 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:05.136446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:05.136514 (+ 68us) server_negotiation.cc:407] Connection header received
0810 06:31:05.136636 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:05.136639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:05.136686 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:05.136760 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:05.137226 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.137948 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.138741 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.138964 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.139035 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:05.141990 (+ 2955us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:39821: BlockingRecv error: recv got EOF from 127.21.195.194:39821 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 06:31:05 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:05 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:05.340070 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:05.334512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:43089)
0810 06:31:05.334817 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:05.334831 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:05.334940 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:05.335197 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:05.335199 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:05.335390 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:05.335496 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:05.335502 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.336229 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.336231 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:05.336784 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:05.336790 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.337242 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.337244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:05.337306 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:05.337866 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:05.337879 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:05.339933 (+ 2054us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":104,"threads_started":1}
W20260810 06:31:05.340205 4673 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:05.334637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:43089 (local address 127.21.195.254:34741)
0810 06:31:05.334777 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:05.334780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:05.334904 (+ 124us) server_negotiation.cc:407] Connection header received
0810 06:31:05.335034 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:05.335037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:05.335087 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:05.335168 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:05.335590 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.336141 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.336907 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.337141 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.337228 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:05.340091 (+ 2863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:43089: BlockingRecv error: recv got EOF from 127.21.195.195:43089 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 10 06:31:05 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:05 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:05.934249 4676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:05.928677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:59129)
0810 06:31:05.928973 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:05.928989 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:05.929088 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:05.929330 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:05.929333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:05.929567 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:05.929670 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:05.929676 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.930411 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.930422 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:05.931015 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:05.931023 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.931420 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.931423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:05.931489 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:05.932002 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:05.932013 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:05.934117 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":82,"threads_started":1}
W20260810 06:31:05.934433 4678 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:05.928762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:59129 (local address 127.21.195.254:34741)
0810 06:31:05.929030 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:05.929033 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:05.929048 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:31:05.929170 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:05.929172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:05.929219 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:05.929302 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:05.929762 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.930304 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.931105 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:05.931326 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:05.931395 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:05.934293 (+ 2898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:59129: BlockingRecv error: recv got EOF from 127.21.195.193:59129 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":85,"threads_started":1}
Aug 10 06:31:06 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:06 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:06.148561 4679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:06.142836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:36547)
0810 06:31:06.143138 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:06.143157 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:06.143298 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:06.143597 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:06.143600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:06.143795 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:06.143904 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:06.143910 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.144721 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.144723 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:06.145329 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:06.145338 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.145786 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.145789 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:06.145853 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:06.146361 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:06.146374 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:06.148414 (+ 2040us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":97,"threads_started":1}
W20260810 06:31:06.148686 4678 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:06.142908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:36547 (local address 127.21.195.254:34741)
0810 06:31:06.143063 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:06.143069 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:06.143263 (+ 194us) server_negotiation.cc:407] Connection header received
0810 06:31:06.143401 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:06.143403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:06.143454 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:06.143532 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:06.144061 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.144633 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.145416 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.145681 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.145759 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:06.148574 (+ 2815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:36547: BlockingRecv error: recv got EOF from 127.21.195.194:36547 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 06:31:06 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:06 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:06.346740 4680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:06.341088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:36099)
0810 06:31:06.341418 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:06.341442 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:06.341591 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:06.341838 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:06.341840 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:06.342043 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:06.342148 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:06.342154 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.342952 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.342954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:06.343527 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:06.343534 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.343928 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.343930 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:06.343990 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:06.344510 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:06.344521 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:06.346582 (+ 2061us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":113,"threads_started":1}
W20260810 06:31:06.346836 4678 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:06.341262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:36099 (local address 127.21.195.254:34741)
0810 06:31:06.341411 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:06.341414 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:06.341534 (+ 120us) server_negotiation.cc:407] Connection header received
0810 06:31:06.341676 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:06.341678 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:06.341726 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:06.341807 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:06.342295 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.342852 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.343614 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.343842 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.343915 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:06.346714 (+ 2799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:36099: BlockingRecv error: recv got EOF from 127.21.195.195:36099 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 06:31:06 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:06 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:06.940747 4681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:06.935231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:50715)
0810 06:31:06.935588 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:06.935601 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:06.935708 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:06.936012 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:06.936015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:06.936255 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:06.936387 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:06.936395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.937178 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.937180 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:06.937787 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:06.937795 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.938224 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.938226 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:06.938286 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:06.938796 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:06.938806 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:06.940619 (+ 1813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":81,"threads_started":1}
W20260810 06:31:06.940959 4682 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:06.935299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:50715 (local address 127.21.195.254:34741)
0810 06:31:06.935682 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:06.935686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:06.935698 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:31:06.935802 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:06.935804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:06.935853 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:06.935991 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:06.936516 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.937083 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.937883 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:06.938136 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:06.938215 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:06.940781 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:50715: BlockingRecv error: recv got EOF from 127.21.195.193:50715 (error 108)
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":72,"threads_started":1}
Aug 10 06:31:07 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:07 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:07.158699 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:07.149744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:58503)
0810 06:31:07.150154 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:07.150172 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:07.150299 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:07.150611 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:07.150614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:07.150853 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:07.151005 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:07.151015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.151864 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.151869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:07.152515 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:07.152528 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.152987 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.152990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:07.153063 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:07.156361 (+ 3298us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:07.156377 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:07.158536 (+ 2159us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":145,"threads_started":1}
W20260810 06:31:07.158852 4682 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:07.149917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:58503 (local address 127.21.195.254:34741)
0810 06:31:07.150135 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:07.150140 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:07.150241 (+ 101us) server_negotiation.cc:407] Connection header received
0810 06:31:07.150405 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:07.150409 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:07.150473 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:07.150561 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:07.151136 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.151724 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.152635 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.152873 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.152954 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:07.158731 (+ 5777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:58503: BlockingRecv error: recv got EOF from 127.21.195.194:58503 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 10 06:31:07 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:07 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:07.353040 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:07.347546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:34297)
0810 06:31:07.347876 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:07.347890 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:07.347986 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:07.348208 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:07.348210 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:07.348406 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:07.348510 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:07.348515 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.349240 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.349243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:07.349879 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:07.349889 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.350323 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.350326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:07.350393 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:07.350931 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:07.350943 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:07.352902 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":99,"threads_started":1}
W20260810 06:31:07.353189 4682 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:07.347759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:34297 (local address 127.21.195.254:34741)
0810 06:31:07.347907 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:07.347911 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:07.347947 (+ 36us) server_negotiation.cc:407] Connection header received
0810 06:31:07.348066 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:07.348069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:07.348115 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:07.348180 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:07.348601 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.349145 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.349997 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.350229 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.350306 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:07.353068 (+ 2762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:34297: BlockingRecv error: recv got EOF from 127.21.195.195:34297 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 06:31:07 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:07 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:07.947593 4687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:07.941754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:47863)
0810 06:31:07.942053 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:07.942072 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:07.942180 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:07.942429 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:07.942431 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:07.942652 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:07.942757 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:07.942764 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.943725 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.943728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:07.944490 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:07.944503 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.944946 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.944949 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:07.945007 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:07.945548 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:07.945565 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:07.947419 (+ 1854us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":80,"threads_started":1}
W20260810 06:31:07.947724 4689 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:07.941898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:47863 (local address 127.21.195.254:34741)
0810 06:31:07.942147 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:07.942151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:07.942168 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:31:07.942270 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:07.942273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:07.942319 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:07.942402 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:07.942891 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.943596 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.944598 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:07.944846 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:07.944935 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:07.947583 (+ 2648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:47863: BlockingRecv error: recv got EOF from 127.21.195.193:47863 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":77,"threads_started":1}
Aug 10 06:31:08 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:08 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:08.165416 4691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:08.159629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:47007)
0810 06:31:08.159957 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:08.159988 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:08.160106 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:08.160383 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:08.160386 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:08.160605 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:08.160710 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:08.160716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.161499 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.161503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:08.162109 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:08.162119 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.162597 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.162601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:08.162692 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:08.163247 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:08.163261 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:08.165243 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":109,"threads_started":1}
W20260810 06:31:08.165586 4689 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:08.159715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:47007 (local address 127.21.195.254:34741)
0810 06:31:08.159908 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:08.159913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:08.160062 (+ 149us) server_negotiation.cc:407] Connection header received
0810 06:31:08.160214 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:08.160217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:08.160270 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:08.160337 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:08.160840 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.161382 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.162233 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.162478 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.162571 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:08.165431 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:47007: BlockingRecv error: recv got EOF from 127.21.195.194:47007 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 10 06:31:08 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:08 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:08.359757 4692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:08.354004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:51061)
0810 06:31:08.354309 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:08.354323 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:08.354435 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:08.354683 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:08.354685 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:08.354881 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:08.355032 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:08.355039 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.355822 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.355825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:08.356399 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:08.356406 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.356886 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.356888 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:08.356961 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:08.357573 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:08.357588 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:08.359586 (+ 1998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":83,"threads_started":1}
W20260810 06:31:08.360016 4689 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:08.354122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:51061 (local address 127.21.195.254:34741)
0810 06:31:08.354261 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:08.354265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:08.354442 (+ 177us) server_negotiation.cc:407] Connection header received
0810 06:31:08.354506 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:08.354509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:08.354565 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:08.354648 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:08.355179 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.355727 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.356535 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.356784 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.356872 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:08.359763 (+ 2891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:51061: BlockingRecv error: recv got EOF from 127.21.195.195:51061 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 06:31:08 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:08 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:08.954820 4693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:08.948521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:33383)
0810 06:31:08.948811 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:08.948829 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:08.948953 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:08.949214 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:08.949217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:08.949408 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:08.949560 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:08.949567 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.950299 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.950302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:08.950920 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:08.950933 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.951618 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.951623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:08.951726 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:08.952292 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:08.952310 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:08.954685 (+ 2375us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":90,"threads_started":1}
W20260810 06:31:08.955049 4694 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:08.948597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:33383 (local address 127.21.195.254:34741)
0810 06:31:08.948875 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:08.948880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:08.948895 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:31:08.949056 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:08.949059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:08.949107 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:08.949186 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:08.949647 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.950202 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.951071 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:08.951437 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:08.951569 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:08.954889 (+ 3320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:33383: BlockingRecv error: recv got EOF from 127.21.195.193:33383 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":97,"threads_started":1}
Aug 10 06:31:09 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:09 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:09.172003 4696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:09.166435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:36585)
0810 06:31:09.166776 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:09.166791 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:09.166924 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:09.167265 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:09.167268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:09.167485 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:09.167592 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:09.167599 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.168340 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.168342 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:09.168946 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:09.168955 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.169347 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.169349 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:09.169411 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:09.169961 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:09.169974 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:09.171872 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":107,"threads_started":1}
W20260810 06:31:09.172169 4694 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:09.166578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:36585 (local address 127.21.195.254:34741)
0810 06:31:09.166768 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:09.166773 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:09.166864 (+ 91us) server_negotiation.cc:407] Connection header received
0810 06:31:09.167050 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:09.167053 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:09.167108 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:09.167185 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:09.167706 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.168245 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.169044 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.169258 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.169331 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:09.172036 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:36585: BlockingRecv error: recv got EOF from 127.21.195.194:36585 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 10 06:31:09 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:09 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:09.366272 4697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:09.360557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:35031)
0810 06:31:09.360864 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:09.360877 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:09.361009 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:09.361267 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:09.361270 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:09.361485 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:09.361634 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:09.361642 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.362408 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.362411 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:09.362991 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:09.363002 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.363465 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.363470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:09.363557 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:09.364135 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:09.364147 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:09.366136 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":98,"threads_started":1}
W20260810 06:31:09.366468 4694 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:09.360649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:35031 (local address 127.21.195.254:34741)
0810 06:31:09.360792 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:09.360796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:09.360964 (+ 168us) server_negotiation.cc:407] Connection header received
0810 06:31:09.361102 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:09.361105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:09.361157 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:09.361224 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:09.361754 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.362289 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.363116 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.363350 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.363449 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:09.366330 (+ 2881us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:35031: BlockingRecv error: recv got EOF from 127.21.195.195:35031 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 10 06:31:09 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:09 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:09.962231 4698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:09.955863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:58339)
0810 06:31:09.956292 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:09.956310 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:09.956452 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:09.956739 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:09.956742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:09.956990 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:09.957131 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:09.957139 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.958276 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.958280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:09.958993 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:09.959005 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.959492 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.959496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:09.959586 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:09.960135 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:09.960148 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:09.962103 (+ 1955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":111,"threads_started":1}
W20260810 06:31:09.962405 4699 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:09.955951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:58339 (local address 127.21.195.254:34741)
0810 06:31:09.956244 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:09.956248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:09.956386 (+ 138us) server_negotiation.cc:407] Connection header received
0810 06:31:09.956557 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:09.956560 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:09.956613 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:09.956695 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:09.957283 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.958147 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.959120 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:09.959365 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:09.959462 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:09.962256 (+ 2794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:58339: BlockingRecv error: recv got EOF from 127.21.195.193:58339 (error 108)
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":80,"threads_started":1}
Aug 10 06:31:10 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:10 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:10.179116 4700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:10.172982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:32883)
0810 06:31:10.173316 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:10.173331 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:10.173446 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:10.173707 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:10.173709 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:10.173916 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:10.174024 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:10.174030 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.174821 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.174825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:10.175484 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:10.175498 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.176011 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.176015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:10.176098 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:10.176709 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:10.176727 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:10.178971 (+ 2244us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":108,"threads_started":1}
W20260810 06:31:10.179243 4699 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:10.173185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:32883 (local address 127.21.195.254:34741)
0810 06:31:10.173380 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:10.173383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:10.173400 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:31:10.173553 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:10.173556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:10.173604 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:10.173678 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:10.174128 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.174673 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.175612 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.175846 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.175929 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:10.179119 (+ 3190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:32883: BlockingRecv error: recv got EOF from 127.21.195.194:32883 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 10 06:31:10 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:10 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:10.373502 4703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:10.367353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:53385)
0810 06:31:10.367663 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:10.367678 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:10.367794 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:10.368154 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:10.368157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:10.368368 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:10.368477 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:10.368482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.369471 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.369474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:10.370125 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:10.370137 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.370588 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.370591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:10.370654 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:10.371217 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:10.371231 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:10.373348 (+ 2117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":112,"threads_started":1}
W20260810 06:31:10.373662 4699 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:10.367499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:53385 (local address 127.21.195.254:34741)
0810 06:31:10.367663 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:10.367667 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:10.367741 (+ 74us) server_negotiation.cc:407] Connection header received
0810 06:31:10.367883 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:10.367885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:10.367976 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:10.368072 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:10.368595 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.369361 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.370238 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.370478 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.370575 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:10.373501 (+ 2926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:53385: BlockingRecv error: recv got EOF from 127.21.195.195:53385 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 10 06:31:10 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:10 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:10.969245 4706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:10.963084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:60795)
0810 06:31:10.963427 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:10.963441 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:10.963545 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:10.963779 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:10.963781 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:10.963977 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:10.964084 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:10.964090 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.965064 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.965068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:10.965891 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:10.965905 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.966431 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.966435 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:10.966531 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:10.967108 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:10.967122 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:10.969111 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":128,"threads_started":1}
W20260810 06:31:10.969451 4709 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:10.963191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:60795 (local address 127.21.195.254:34741)
0810 06:31:10.963538 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:10.963542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:10.963559 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:31:10.963609 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:10.963611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:10.963657 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:10.963752 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:10.964216 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.964936 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.966025 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:10.966276 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:10.966370 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:10.969293 (+ 2923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:60795: BlockingRecv error: recv got EOF from 127.21.195.193:60795 (error 108)
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":66,"threads_started":1}
Aug 10 06:31:11 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:11 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:11.185887 4710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:11.179998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:44707)
0810 06:31:11.180588 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:11.180606 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:11.180718 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:11.181036 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:11.181040 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:11.181245 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:11.181354 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:11.181361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.182224 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.182227 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:11.182831 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:11.182841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.183271 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.183273 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:11.183338 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:11.183892 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:11.183908 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:11.185735 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":96,"threads_started":1}
W20260810 06:31:11.186033 4709 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:11.180037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:44707 (local address 127.21.195.254:34741)
0810 06:31:11.180181 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:11.180185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:11.180797 (+ 612us) server_negotiation.cc:407] Connection header received
0810 06:31:11.180838 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:11.180840 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:11.180895 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:11.180977 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:11.181493 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.182085 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.182934 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.183161 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.183233 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:11.185905 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:44707: BlockingRecv error: recv got EOF from 127.21.195.194:44707 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 10 06:31:11 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:11 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.195@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:11.380390 4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:11.374296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.195:39415)
0810 06:31:11.374569 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:11.374584 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:11.374684 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:11.374941 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:11.374943 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:11.375159 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:11.375265 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:11.375272 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.376321 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.376325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:11.376943 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:11.376954 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.377490 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.377494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:11.377627 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:11.378140 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:11.378152 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:11.380235 (+ 2083us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":76,"threads_started":1}
W20260810 06:31:11.380514 4709 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:11.374427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:39415 (local address 127.21.195.254:34741)
0810 06:31:11.374625 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:11.374629 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:11.374643 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:31:11.374763 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:11.374766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:11.374814 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:11.374879 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:11.375413 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.376209 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.377090 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.377342 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.377447 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:11.380390 (+ 2943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.195:39415: BlockingRecv error: recv got EOF from 127.21.195.195:39415 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 10 06:31:11 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:11 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.193@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:11.976361 4713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:11.970458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.193:33141)
0810 06:31:11.970774 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:11.970798 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:11.970895 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:11.971126 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:11.971128 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:11.971324 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:11.971428 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:11.971434 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.972193 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.972197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:11.972798 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:11.972809 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.973284 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.973287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:11.973351 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:11.973957 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:11.973973 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:11.976196 (+ 2223us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":94,"threads_started":1}
W20260810 06:31:11.976511 4714 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:11.970608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:33141 (local address 127.21.195.254:34741)
0810 06:31:11.970868 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:11.970873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:11.970889 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:31:11.970980 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:11.970983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:11.971027 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:11.971098 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:11.971529 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.972072 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.972928 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:11.973178 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:11.973267 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:11.976368 (+ 3101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.193:33141: BlockingRecv error: recv got EOF from 127.21.195.193:33141 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":77,"threads_started":1}
Aug 10 06:31:12 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 06:31:12 dist-test-slave-7lbf krb5kdc[3059](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.195.194@KRBTEST.COM for oryx/127.21.195.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 06:31:12.197095 4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:12.186981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:34741 (local address 127.21.195.194:59251)
0810 06:31:12.187305 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:12.187319 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:12.187446 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:12.187711 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:12.187714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:12.187942 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:12.188044 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:12.188050 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.188829 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.188833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:12.189414 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:12.189435 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.189923 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.189927 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:12.190010 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:12.194809 (+ 4799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:12.194825 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:12.196936 (+ 2111us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.195.254:34741: Server oryx/127.21.195.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":122,"threads_started":1}
W20260810 06:31:12.197229 4714 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:12.187075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:59251 (local address 127.21.195.254:34741)
0810 06:31:12.187232 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:12.187237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:12.187390 (+ 153us) server_negotiation.cc:407] Connection header received
0810 06:31:12.187546 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:12.187548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:12.187597 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:12.187673 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:12.188176 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.188714 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.189575 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.189808 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.189902 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:12.197112 (+ 7210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.195.194:59251: BlockingRecv error: recv got EOF from 127.21.195.194:59251 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:31:12.262828 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 3949
I20260810 06:31:12.280488 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 4190
I20260810 06:31:12.294209 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 4401
I20260810 06:31:12.308091 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 3828
2026-08-10T06:31:12Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18354 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T06:31:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:31:12Z Disabled control of system clock
I20260810 06:31:12.352214 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:41255
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:46079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:41255
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 06:31:12.473598 4720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:12.473923 4720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:12.473959 4720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:12.478143 4720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:31:12.478242 4720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:12.478266 4720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:12.478286 4720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:31:12.478299 4720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:31:12.483409 4720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:41255
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:41255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:12.484649 4720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:12.486169 4720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:12.497152 4727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:12.497154 4729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:12.497253 4720 server_base.cc:1034] running on GCE node
W20260810 06:31:12.497604 4734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:12.498569 4720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:12.501740 4720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:12.502931 4720 hybrid_clock.cc:648] HybridClock initialized: now 1786343472502913 us; error 66 us; skew 500 ppm
I20260810 06:31:12.505640 4720 webserver.cc:460] Webserver started at http://127.21.195.254:42411/ using document root <none> and password file <none>
I20260810 06:31:12.506515 4720 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:12.506628 4720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:12.506916 4720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:12.510178 4720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "b66ded3eef6146499b28437e0262630d"
format_stamp: "Formatted at 2026-08-10 06:31:12 on dist-test-slave-7lbf"
server_key: "ca80376a1461ff0676bc857a7c91895a"
server_key_iv: "ee11eab04bab0d05ab8924610f476284"
server_key_version: "encryptionkey@0"
I20260810 06:31:12.511267 4720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "b66ded3eef6146499b28437e0262630d"
format_stamp: "Formatted at 2026-08-10 06:31:12 on dist-test-slave-7lbf"
server_key: "ca80376a1461ff0676bc857a7c91895a"
server_key_iv: "ee11eab04bab0d05ab8924610f476284"
server_key_version: "encryptionkey@0"
I20260810 06:31:12.518769 4720 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260810 06:31:12.522573 4745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:12.524456 4720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:31:12.524682 4720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "b66ded3eef6146499b28437e0262630d"
format_stamp: "Formatted at 2026-08-10 06:31:12 on dist-test-slave-7lbf"
server_key: "ca80376a1461ff0676bc857a7c91895a"
server_key_iv: "ee11eab04bab0d05ab8924610f476284"
server_key_version: "encryptionkey@0"
I20260810 06:31:12.524852 4720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:12.554894 4720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:12.555719 4720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:12.555897 4720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:12.563242 4720 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:41255
I20260810 06:31:12.563263 4843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:41255 every 8 connection(s)
I20260810 06:31:12.564316 4720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:31:12.567868 4845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:31:12.569880 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 4720
I20260810 06:31:12.569994 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:31:12.570267 22287 external_mini_cluster.cc:1428] Setting key e0aa1d403e4bd52c5c96af5056bba370
I20260810 06:31:12.575170 4845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d: Bootstrap starting.
I20260810 06:31:12.577702 4845 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d: Neither blocks nor log segments found. Creating new log.
I20260810 06:31:12.578519 4845 log.cc:824] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d: Log is configured to *not* fsync() on all Append() calls
I20260810 06:31:12.579978 4850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:12.571846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35636 (local address 127.21.195.254:41255)
0810 06:31:12.572578 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:12.572595 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:12.572635 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:31:12.573367 (+ 732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:12.573387 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:12.573891 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:12.574228 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:12.574696 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.575698 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.576614 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.577113 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.577270 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:12.578162 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:12.578168 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:12.578183 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:31:12.578605 (+ 422us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:12.578666 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:31:12.578694 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:12.578792 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:12.578935 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 06:31:12.579216 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":148,"threads_started":1}
I20260810 06:31:12.580703 4845 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d: No bootstrap required, opened a new log
I20260810 06:31:12.584666 4845 raft_consensus.cc:348] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66ded3eef6146499b28437e0262630d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41255 } }
I20260810 06:31:12.585002 4845 raft_consensus.cc:374] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:31:12.585074 4845 raft_consensus.cc:729] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b66ded3eef6146499b28437e0262630d, State: Initialized, Role: FOLLOWER
I20260810 06:31:12.585610 4845 consensus_queue.cc:260] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66ded3eef6146499b28437e0262630d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41255 } }
I20260810 06:31:12.585760 4845 raft_consensus.cc:388] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:31:12.585826 4845 raft_consensus.cc:482] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:31:12.585935 4845 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:31:12.586952 4845 raft_consensus.cc:504] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66ded3eef6146499b28437e0262630d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41255 } }
I20260810 06:31:12.587303 4845 leader_election.cc:302] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b66ded3eef6146499b28437e0262630d; no voters:
I20260810 06:31:12.587656 4845 leader_election.cc:288] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:31:12.587746 4852 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:31:12.588023 4852 raft_consensus.cc:686] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [term 1 LEADER]: Becoming Leader. State: Replica: b66ded3eef6146499b28437e0262630d, State: Running, Role: LEADER
I20260810 06:31:12.588394 4852 consensus_queue.cc:237] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66ded3eef6146499b28437e0262630d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41255 } }
I20260810 06:31:12.589013 4845 sys_catalog.cc:564] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:31:12.590247 4856 sys_catalog.cc:455] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b66ded3eef6146499b28437e0262630d. Latest consensus state: current_term: 1 leader_uuid: "b66ded3eef6146499b28437e0262630d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66ded3eef6146499b28437e0262630d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41255 } } }
I20260810 06:31:12.590389 4856 sys_catalog.cc:458] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [sys.catalog]: This master's current role is: LEADER
I20260810 06:31:12.590386 4853 sys_catalog.cc:455] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b66ded3eef6146499b28437e0262630d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b66ded3eef6146499b28437e0262630d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41255 } } }
I20260810 06:31:12.590487 4853 sys_catalog.cc:458] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d [sys.catalog]: This master's current role is: LEADER
I20260810 06:31:12.590852 4873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:31:12.593962 4873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:31:12.599874 4873 catalog_manager.cc:1347] Generated new cluster ID: 8287dfbe9611484c9b688de57e781c6e
I20260810 06:31:12.599979 4873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:31:12.628624 4873 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:31:12.630174 4873 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:31:12.640257 4873 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b66ded3eef6146499b28437e0262630d: Generated new TSK 0
I20260810 06:31:12.641304 4873 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:31:12.646422 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41255
--builtin_ntp_servers=127.21.195.212:46079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 06:31:12.771252 4891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:12.771579 4891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:12.771620 4891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:12.775892 4891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:12.775980 4891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:12.776039 4891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:31:12.781030 4891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:12.782344 4891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:12.783977 4891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:12.802650 4901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:12.802798 4905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:12.802680 4899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:12.803207 4891 server_base.cc:1034] running on GCE node
I20260810 06:31:12.803782 4891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:12.804735 4891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:12.805994 4891 hybrid_clock.cc:648] HybridClock initialized: now 1786343472805906 us; error 102 us; skew 500 ppm
I20260810 06:31:12.808532 4891 webserver.cc:460] Webserver started at http://127.21.195.193:42113/ using document root <none> and password file <none>
I20260810 06:31:12.809330 4891 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:12.809437 4891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:12.809765 4891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:12.812248 4891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "7744637b199546808464e697c4aef03b"
format_stamp: "Formatted at 2026-08-10 06:31:12 on dist-test-slave-7lbf"
server_key: "b7c2d110292994f8d3116a4ba4eb5d48"
server_key_iv: "0d48baec3c4e957851978b6a5acf28b2"
server_key_version: "encryptionkey@0"
I20260810 06:31:12.812891 4891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "7744637b199546808464e697c4aef03b"
format_stamp: "Formatted at 2026-08-10 06:31:12 on dist-test-slave-7lbf"
server_key: "b7c2d110292994f8d3116a4ba4eb5d48"
server_key_iv: "0d48baec3c4e957851978b6a5acf28b2"
server_key_version: "encryptionkey@0"
I20260810 06:31:12.818231 4891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260810 06:31:12.822212 4914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:12.823987 4891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:31:12.824142 4891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "7744637b199546808464e697c4aef03b"
format_stamp: "Formatted at 2026-08-10 06:31:12 on dist-test-slave-7lbf"
server_key: "b7c2d110292994f8d3116a4ba4eb5d48"
server_key_iv: "0d48baec3c4e957851978b6a5acf28b2"
server_key_version: "encryptionkey@0"
I20260810 06:31:12.824298 4891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:12.874946 4891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:12.875770 4891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:12.875950 4891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:12.876595 4891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:12.877692 4891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:12.877748 4891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:12.877790 4891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:12.877811 4891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:12.887053 4891 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:44775
I20260810 06:31:12.887080 5099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:44775 every 8 connection(s)
I20260810 06:31:12.888128 4891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:31:12.895354 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 4891
I20260810 06:31:12.895491 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:31:12.895818 22287 external_mini_cluster.cc:1428] Setting key 9de8fb3a0303bed2f93b40618ec17762
I20260810 06:31:12.898000 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41255
--builtin_ntp_servers=127.21.195.212:46079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 06:31:12.899399 4850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:12.890286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:42837 (local address 127.21.195.254:41255)
0810 06:31:12.890429 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:12.890433 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:12.891933 (+ 1500us) server_negotiation.cc:407] Connection header received
0810 06:31:12.893459 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:12.893462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:12.893572 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:12.893658 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:12.894790 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.895572 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.897117 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.897440 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.897580 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:12.898876 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:12.898880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:12.898883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:31:12.898897 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:12.898920 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:31:12.898928 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:12.898996 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:12.899162 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 06:31:12.899247 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:31:12.900512 5104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:12.890960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41255 (local address 127.21.195.193:42837)
0810 06:31:12.891754 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:12.891802 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:12.893197 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:12.893852 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:12.893860 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:12.893965 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:12.894600 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:12.894617 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.895739 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.895742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:12.896973 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:12.896985 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:12.897662 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:12.897667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:12.897861 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:12.898559 (+ 698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:31:12.898560 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:12.898613 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:31:12.898698 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:12.899002 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:12.899014 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:12.899021 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:31:12.899150 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 06:31:12.899546 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":143,"threads_started":1}
I20260810 06:31:12.902002 5100 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41255
I20260810 06:31:12.902334 5100 heartbeater.cc:464] Registering TS with master...
I20260810 06:31:12.903151 5100 heartbeater.cc:511] Master 127.21.195.254:41255 requested a full tablet report, sending...
I20260810 06:31:12.905246 4772 ts_manager.cc:194] Registered new tserver with Master: 7744637b199546808464e697c4aef03b (127.21.195.193:44775)
I20260810 06:31:12.907061 4772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.193:42837
W20260810 06:31:13.025310 5107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:13.025645 5107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:13.025686 5107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:13.029923 5107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:13.029999 5107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:13.030058 5107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:31:13.035243 5107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:13.036495 5107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:13.038064 5107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:13.048703 5113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:13.048631 5112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:13.048664 5107 server_base.cc:1034] running on GCE node
W20260810 06:31:13.048661 5116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:13.049439 5107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:13.050176 5107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:13.051337 5107 hybrid_clock.cc:648] HybridClock initialized: now 1786343473051312 us; error 39 us; skew 500 ppm
I20260810 06:31:13.053395 5107 webserver.cc:460] Webserver started at http://127.21.195.194:41869/ using document root <none> and password file <none>
I20260810 06:31:13.054087 5107 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:13.054160 5107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:13.054392 5107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:13.056672 5107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "a0161bd77c364cd0a8ad47fc20f9c307"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "dd3697742d4f989f3ed17180a7bb1f8a"
server_key_iv: "7e328b509b757ef3f26cab9bafd76bb5"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.057305 5107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "a0161bd77c364cd0a8ad47fc20f9c307"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "dd3697742d4f989f3ed17180a7bb1f8a"
server_key_iv: "7e328b509b757ef3f26cab9bafd76bb5"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.061661 5107 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:31:13.064502 5124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.066005 5107 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:31:13.066126 5107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "a0161bd77c364cd0a8ad47fc20f9c307"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "dd3697742d4f989f3ed17180a7bb1f8a"
server_key_iv: "7e328b509b757ef3f26cab9bafd76bb5"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.066248 5107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:13.091187 5107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:13.092041 5107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:13.092232 5107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:13.092927 5107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:13.094143 5107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:13.094193 5107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.094241 5107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:13.094270 5107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.103493 5107 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:35199
I20260810 06:31:13.103519 5304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:35199 every 8 connection(s)
I20260810 06:31:13.104614 5107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:31:13.106447 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 5107
I20260810 06:31:13.106550 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:31:13.106863 22287 external_mini_cluster.cc:1428] Setting key f71cbd5e0765b2b514fb5baa8d9135a0
I20260810 06:31:13.109267 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41255
--builtin_ntp_servers=127.21.195.212:46079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 06:31:13.115958 4850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:13.106739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:59745 (local address 127.21.195.254:41255)
0810 06:31:13.106915 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:13.106920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:13.108362 (+ 1442us) server_negotiation.cc:407] Connection header received
0810 06:31:13.110308 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:13.110311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:13.110361 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:13.110432 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:13.111642 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:13.112437 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:13.113761 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:13.114124 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:13.114238 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:13.115417 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:13.115421 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:13.115424 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:31:13.115441 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:13.115468 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:31:13.115479 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:13.115563 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:13.115690 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 06:31:13.115769 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:31:13.116892 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:13.107287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41255 (local address 127.21.195.194:59745)
0810 06:31:13.108209 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:13.108262 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:13.110049 (+ 1787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:13.110653 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:13.110663 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:13.110785 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:13.111476 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:13.111492 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:13.112596 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:13.112600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:13.113625 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:13.113636 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:13.114275 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:13.114279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:13.114487 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:13.115117 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:31:13.115119 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:13.115169 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:31:13.115248 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:13.115560 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:13.115565 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:13.115569 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:31:13.115665 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 06:31:13.115944 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":160,"threads_started":1}
I20260810 06:31:13.118239 5306 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41255
I20260810 06:31:13.118541 5306 heartbeater.cc:464] Registering TS with master...
I20260810 06:31:13.119132 5306 heartbeater.cc:511] Master 127.21.195.254:41255 requested a full tablet report, sending...
I20260810 06:31:13.120330 4772 ts_manager.cc:194] Registered new tserver with Master: a0161bd77c364cd0a8ad47fc20f9c307 (127.21.195.194:35199)
I20260810 06:31:13.120970 4772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.194:59745
W20260810 06:31:13.233651 5309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:13.233976 5309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:13.234015 5309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:13.238269 5309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:13.238354 5309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:13.238413 5309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:31:13.243494 5309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41255
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:13.244797 5309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:13.246423 5309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:13.257002 5316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:13.257202 5309 server_base.cc:1034] running on GCE node
W20260810 06:31:13.257016 5320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:13.257007 5315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:13.257879 5309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:13.258620 5309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:13.259788 5309 hybrid_clock.cc:648] HybridClock initialized: now 1786343473259763 us; error 39 us; skew 500 ppm
I20260810 06:31:13.261864 5309 webserver.cc:460] Webserver started at http://127.21.195.195:39631/ using document root <none> and password file <none>
I20260810 06:31:13.262530 5309 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:13.262611 5309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:13.262859 5309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:13.265202 5309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "18fd365c8692479893d0e4c451c2641e"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "60d008fe89c3395f15493d6f67a8836e"
server_key_iv: "271e56674966fbb9121a58735ae1c948"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.265903 5309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "18fd365c8692479893d0e4c451c2641e"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "60d008fe89c3395f15493d6f67a8836e"
server_key_iv: "271e56674966fbb9121a58735ae1c948"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.270273 5309 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:31:13.273335 5330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.274808 5309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:31:13.274950 5309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "18fd365c8692479893d0e4c451c2641e"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "60d008fe89c3395f15493d6f67a8836e"
server_key_iv: "271e56674966fbb9121a58735ae1c948"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.275081 5309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:13.288609 5309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:13.289476 5309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:13.289721 5309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:13.290448 5309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:13.291594 5309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:13.291647 5309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.291707 5309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:13.291738 5309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.300534 5309 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:33441
I20260810 06:31:13.300594 5511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:33441 every 8 connection(s)
I20260810 06:31:13.301623 5309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:31:13.308072 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 5309
I20260810 06:31:13.308188 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:31:13.308468 22287 external_mini_cluster.cc:1428] Setting key 4afa22d4a3e913753f6317454d82a944
I20260810 06:31:13.312036 4850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:13.303746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:41521 (local address 127.21.195.254:41255)
0810 06:31:13.303917 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:13.303921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:13.305216 (+ 1295us) server_negotiation.cc:407] Connection header received
0810 06:31:13.306755 (+ 1539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:13.306759 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:13.306824 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:13.306898 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:13.307921 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:13.308525 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:13.310100 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:13.310340 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:13.310421 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:13.311618 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:13.311621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:13.311623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:31:13.311636 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:13.311658 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:31:13.311665 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:13.311725 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:13.311842 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 06:31:13.311902 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 06:31:13.313009 5515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:13.304238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41255 (local address 127.21.195.195:41521)
0810 06:31:13.305042 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:13.305091 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:13.306525 (+ 1434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:13.307109 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:13.307118 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:13.307214 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:13.307760 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:13.307775 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:13.308654 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:13.308657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:13.309963 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:13.309977 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:13.310517 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:13.310522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:13.310722 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:13.311339 (+ 617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:31:13.311340 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:13.311389 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:31:13.311473 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:13.311732 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:13.311738 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:13.311742 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:31:13.311838 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 06:31:13.312124 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":150,"threads_started":1}
I20260810 06:31:13.314227 5512 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41255
I20260810 06:31:13.314494 5512 heartbeater.cc:464] Registering TS with master...
I20260810 06:31:13.315054 5512 heartbeater.cc:511] Master 127.21.195.254:41255 requested a full tablet report, sending...
I20260810 06:31:13.316217 4772 ts_manager.cc:194] Registered new tserver with Master: 18fd365c8692479893d0e4c451c2641e (127.21.195.195:33441)
I20260810 06:31:13.317008 4772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.195:41521
I20260810 06:31:13.322623 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 06:31:13.325508 4850 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:13.324646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35638 (local address 127.21.195.254:41255)
0810 06:31:13.324801 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:13.324806 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:13.324937 (+ 131us) server_negotiation.cc:407] Connection header received
0810 06:31:13.325029 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:13.325031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:13.325078 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:13.325143 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:13.325356 (+ 213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35638: BlockingRecv error: recv got EOF from 127.0.0.1:35638 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:31:13.325663 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 4891
I20260810 06:31:13.352185 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 5107
I20260810 06:31:13.363351 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 5309
I20260810 06:31:13.374810 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 4720
2026-08-10T06:31:13Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (1059 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T06:31:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:31:13Z Disabled control of system clock
I20260810 06:31:13.412887 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:40293
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:35509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:40293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 06:31:13.536214 5532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:13.536548 5532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:13.536588 5532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:13.540920 5532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:31:13.541002 5532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:13.541016 5532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:13.541033 5532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:31:13.541047 5532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:31:13.546200 5532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:35509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:40293
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:40293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:13.547462 5532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:13.549018 5532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:13.558418 5540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:13.558405 5538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:13.558446 5544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:13.558750 5532 server_base.cc:1034] running on GCE node
I20260810 06:31:13.559419 5532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:13.560706 5532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:13.561877 5532 hybrid_clock.cc:648] HybridClock initialized: now 1786343473561829 us; error 50 us; skew 500 ppm
I20260810 06:31:13.563884 5532 webserver.cc:460] Webserver started at http://127.21.195.254:38303/ using document root <none> and password file <none>
I20260810 06:31:13.564554 5532 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:13.564636 5532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:13.564877 5532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:13.567219 5532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "817ee88c9a0449d4a5a56735741730b2"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "310d748083beb89272cf5b6b802c176b"
server_key_iv: "427513db0b38b5a498fa181dff361e32"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.567826 5532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "817ee88c9a0449d4a5a56735741730b2"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "310d748083beb89272cf5b6b802c176b"
server_key_iv: "427513db0b38b5a498fa181dff361e32"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.572018 5532 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:31:13.574738 5557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.576172 5532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:31:13.576320 5532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "817ee88c9a0449d4a5a56735741730b2"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "310d748083beb89272cf5b6b802c176b"
server_key_iv: "427513db0b38b5a498fa181dff361e32"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.576445 5532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:13.581539 5532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:13.582238 5532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:13.582413 5532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:13.589313 5532 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:40293
I20260810 06:31:13.589326 5636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:40293 every 8 connection(s)
I20260810 06:31:13.590478 5532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:31:13.594355 5637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:31:13.600283 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 5532
I20260810 06:31:13.600431 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:31:13.600713 22287 external_mini_cluster.cc:1428] Setting key 1b275eaaa99492b858e57141aa063d41
I20260810 06:31:13.601188 5637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2: Bootstrap starting.
I20260810 06:31:13.604108 5637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2: Neither blocks nor log segments found. Creating new log.
I20260810 06:31:13.605034 5637 log.cc:824] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2: Log is configured to *not* fsync() on all Append() calls
I20260810 06:31:13.606977 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:13.602283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55866 (local address 127.21.195.254:40293)
0810 06:31:13.603134 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:13.603157 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:13.603208 (+ 51us) server_negotiation.cc:407] Connection header received
0810 06:31:13.603972 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:13.603994 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:13.604435 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:13.604787 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:13.605601 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:13.605607 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:13.605620 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:31:13.605630 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:13.605691 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:31:13.605708 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:13.605812 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:13.605950 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 06:31:13.606212 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":170,"threads_started":1}
I20260810 06:31:13.607372 5637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2: No bootstrap required, opened a new log
I20260810 06:31:13.611444 5637 raft_consensus.cc:348] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817ee88c9a0449d4a5a56735741730b2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40293 } }
I20260810 06:31:13.611725 5637 raft_consensus.cc:374] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:31:13.611780 5637 raft_consensus.cc:729] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 817ee88c9a0449d4a5a56735741730b2, State: Initialized, Role: FOLLOWER
I20260810 06:31:13.612250 5637 consensus_queue.cc:260] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817ee88c9a0449d4a5a56735741730b2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40293 } }
I20260810 06:31:13.612387 5637 raft_consensus.cc:388] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:31:13.612452 5637 raft_consensus.cc:482] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:31:13.612546 5637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:31:13.613607 5637 raft_consensus.cc:504] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817ee88c9a0449d4a5a56735741730b2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40293 } }
I20260810 06:31:13.613994 5637 leader_election.cc:302] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 817ee88c9a0449d4a5a56735741730b2; no voters:
I20260810 06:31:13.614333 5637 leader_election.cc:288] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:31:13.614476 5643 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:31:13.614682 5643 raft_consensus.cc:686] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [term 1 LEADER]: Becoming Leader. State: Replica: 817ee88c9a0449d4a5a56735741730b2, State: Running, Role: LEADER
I20260810 06:31:13.615016 5643 consensus_queue.cc:237] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817ee88c9a0449d4a5a56735741730b2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40293 } }
I20260810 06:31:13.615666 5637 sys_catalog.cc:564] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:31:13.616899 5648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 817ee88c9a0449d4a5a56735741730b2. Latest consensus state: current_term: 1 leader_uuid: "817ee88c9a0449d4a5a56735741730b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817ee88c9a0449d4a5a56735741730b2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40293 } } }
I20260810 06:31:13.616936 5646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "817ee88c9a0449d4a5a56735741730b2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "817ee88c9a0449d4a5a56735741730b2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 40293 } } }
I20260810 06:31:13.617038 5648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [sys.catalog]: This master's current role is: LEADER
I20260810 06:31:13.617044 5646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2 [sys.catalog]: This master's current role is: LEADER
I20260810 06:31:13.617487 5661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:31:13.621210 5661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:31:13.627692 5661 catalog_manager.cc:1347] Generated new cluster ID: 8078f813b24542f491fe4d568cdef03f
I20260810 06:31:13.627792 5661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:31:13.644794 5661 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:31:13.645207 5661 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:31:13.650840 5661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 817ee88c9a0449d4a5a56735741730b2: Generated new TSK 0
I20260810 06:31:13.651814 5661 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:31:13.664155 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40293
--builtin_ntp_servers=127.21.195.212:35509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 06:31:13.788673 5674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:13.789026 5674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:13.789070 5674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:13.793473 5674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:13.793593 5674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:13.793679 5674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:31:13.798846 5674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:35509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:13.800125 5674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:13.801767 5674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:13.812508 5691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:13.812484 5684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:13.812517 5687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:13.812902 5674 server_base.cc:1034] running on GCE node
I20260810 06:31:13.813369 5674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:13.814127 5674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:13.815340 5674 hybrid_clock.cc:648] HybridClock initialized: now 1786343473815312 us; error 38 us; skew 500 ppm
I20260810 06:31:13.817692 5674 webserver.cc:460] Webserver started at http://127.21.195.193:43641/ using document root <none> and password file <none>
I20260810 06:31:13.818359 5674 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:13.818431 5674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:13.818671 5674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:13.821056 5674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "de26a758caf4450b92c028b2028e11b5"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "a833ab2b653b28e797f95fed0cb13c7b"
server_key_iv: "dc99c94afb67217ceb8c791d004a9ea6"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.821722 5674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "de26a758caf4450b92c028b2028e11b5"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "a833ab2b653b28e797f95fed0cb13c7b"
server_key_iv: "dc99c94afb67217ceb8c791d004a9ea6"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.826177 5674 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:31:13.829267 5699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.830799 5674 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:31:13.830940 5674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "de26a758caf4450b92c028b2028e11b5"
format_stamp: "Formatted at 2026-08-10 06:31:13 on dist-test-slave-7lbf"
server_key: "a833ab2b653b28e797f95fed0cb13c7b"
server_key_iv: "dc99c94afb67217ceb8c791d004a9ea6"
server_key_version: "encryptionkey@0"
I20260810 06:31:13.831117 5674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:13.836270 5674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:13.836980 5674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:13.837164 5674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:13.837898 5674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:13.838944 5674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:13.838994 5674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.839039 5674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:13.839068 5674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:13.848045 5674 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:36701
I20260810 06:31:13.848088 5880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:36701 every 8 connection(s)
I20260810 06:31:13.849089 5674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:31:13.852258 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 5674
I20260810 06:31:13.852387 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:31:13.852732 22287 external_mini_cluster.cc:1428] Setting key 821981014f1102cdbdd375c7269b1651
I20260810 06:31:13.855015 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40293
--builtin_ntp_servers=127.21.195.212:35509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 06:31:13.856205 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:13.851203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:43375 (local address 127.21.195.254:40293)
0810 06:31:13.851354 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:13.851358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:13.852623 (+ 1265us) server_negotiation.cc:407] Connection header received
0810 06:31:13.854368 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:13.854372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:13.854421 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:13.854521 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:13.855751 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:13.855756 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:13.855758 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:31:13.855773 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:13.855800 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:31:13.855810 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:13.855909 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:13.856019 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 06:31:13.856066 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 06:31:13.857211 5888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:13.851662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:40293 (local address 127.21.195.193:43375)
0810 06:31:13.852441 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:13.852503 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:13.854097 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:13.854697 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:13.854704 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:13.854806 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:13.855454 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:31:13.855455 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:13.855506 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:31:13.855589 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:13.855891 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:13.855896 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:13.855901 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:31:13.856049 (+ 148us) client_negotiation.cc:240] Negotiation successful
0810 06:31:13.856288 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":129,"threads_started":1}
I20260810 06:31:13.858574 5882 heartbeater.cc:347] Connected to a master server at 127.21.195.254:40293
I20260810 06:31:13.858860 5882 heartbeater.cc:464] Registering TS with master...
I20260810 06:31:13.859385 5882 heartbeater.cc:511] Master 127.21.195.254:40293 requested a full tablet report, sending...
I20260810 06:31:13.861243 5579 ts_manager.cc:194] Registered new tserver with Master: de26a758caf4450b92c028b2028e11b5 (127.21.195.193:36701)
W20260810 06:31:13.979990 5889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:13.980335 5889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:13.980408 5889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:13.984740 5889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:13.984828 5889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:13.984915 5889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:31:13.990139 5889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:35509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:13.991405 5889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:13.993079 5889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:31:14.004197 5889 server_base.cc:1034] running on GCE node
W20260810 06:31:14.004156 5898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:14.004174 5895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:14.004168 5900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:14.005048 5889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:14.005858 5889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:14.007046 5889 hybrid_clock.cc:648] HybridClock initialized: now 1786343474007020 us; error 40 us; skew 500 ppm
I20260810 06:31:14.009301 5889 webserver.cc:460] Webserver started at http://127.21.195.194:43239/ using document root <none> and password file <none>
I20260810 06:31:14.010011 5889 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:14.010092 5889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:14.010324 5889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:14.012684 5889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "28129e01b92144d0b956d956a70bd260"
format_stamp: "Formatted at 2026-08-10 06:31:14 on dist-test-slave-7lbf"
server_key: "3e8e537a7bf94772075da7f425070d63"
server_key_iv: "b12f2c9e92085f8cec9ec5b6cbf8e0ac"
server_key_version: "encryptionkey@0"
I20260810 06:31:14.013332 5889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "28129e01b92144d0b956d956a70bd260"
format_stamp: "Formatted at 2026-08-10 06:31:14 on dist-test-slave-7lbf"
server_key: "3e8e537a7bf94772075da7f425070d63"
server_key_iv: "b12f2c9e92085f8cec9ec5b6cbf8e0ac"
server_key_version: "encryptionkey@0"
I20260810 06:31:14.017884 5889 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:31:14.020879 5910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:14.022372 5889 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:31:14.022535 5889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "28129e01b92144d0b956d956a70bd260"
format_stamp: "Formatted at 2026-08-10 06:31:14 on dist-test-slave-7lbf"
server_key: "3e8e537a7bf94772075da7f425070d63"
server_key_iv: "b12f2c9e92085f8cec9ec5b6cbf8e0ac"
server_key_version: "encryptionkey@0"
I20260810 06:31:14.022661 5889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:14.027763 5889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:14.028491 5889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:14.028676 5889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:14.029294 5889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:14.030427 5889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:14.030481 5889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:14.030565 5889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:14.030591 5889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:14.039578 5889 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:46117
I20260810 06:31:14.039626 6082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:46117 every 8 connection(s)
I20260810 06:31:14.040624 5889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:31:14.043022 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 5889
I20260810 06:31:14.043143 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:31:14.043433 22287 external_mini_cluster.cc:1428] Setting key 14a4795051d36d582d778dde0f2d2749
I20260810 06:31:14.045794 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40293
--builtin_ntp_servers=127.21.195.212:35509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 06:31:14.048003 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:14.042676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:39569 (local address 127.21.195.254:40293)
0810 06:31:14.042861 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:14.042866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:14.044254 (+ 1388us) server_negotiation.cc:407] Connection header received
0810 06:31:14.045991 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:14.045996 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:14.046045 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:14.046134 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:14.047482 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:14.047485 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:14.047487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:31:14.047500 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:14.047523 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:31:14.047532 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:14.047626 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:14.047794 (+ 168us) server_negotiation.cc:299] Negotiation successful
0810 06:31:14.047848 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 06:31:14.049053 6088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:14.043190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:40293 (local address 127.21.195.194:39569)
0810 06:31:14.044068 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:14.044134 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:14.045696 (+ 1562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:14.046365 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:14.046385 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:14.046522 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:14.047126 (+ 604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:31:14.047128 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:14.047191 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:31:14.047293 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:14.047639 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:14.047651 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:14.047658 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:31:14.047842 (+ 184us) client_negotiation.cc:240] Negotiation successful
0810 06:31:14.048155 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":142,"threads_started":1}
I20260810 06:31:14.050359 6084 heartbeater.cc:347] Connected to a master server at 127.21.195.254:40293
I20260810 06:31:14.050647 6084 heartbeater.cc:464] Registering TS with master...
I20260810 06:31:14.051163 6084 heartbeater.cc:511] Master 127.21.195.254:40293 requested a full tablet report, sending...
I20260810 06:31:14.052364 5579 ts_manager.cc:194] Registered new tserver with Master: 28129e01b92144d0b956d956a70bd260 (127.21.195.194:46117)
W20260810 06:31:14.171584 6089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:14.171931 6089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:14.171993 6089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:14.176393 6089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:14.176479 6089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:14.176561 6089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:31:14.181906 6089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:35509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:40293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:14.183207 6089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:14.184842 6089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:14.195564 6095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:14.195565 6096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:14.195564 6099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:14.195847 6089 server_base.cc:1034] running on GCE node
I20260810 06:31:14.196408 6089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:14.197202 6089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:14.198360 6089 hybrid_clock.cc:648] HybridClock initialized: now 1786343474198306 us; error 68 us; skew 500 ppm
I20260810 06:31:14.200603 6089 webserver.cc:460] Webserver started at http://127.21.195.195:43827/ using document root <none> and password file <none>
I20260810 06:31:14.201233 6089 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:14.201300 6089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:14.201498 6089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:14.203890 6089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "d74a56e449664a7ebd4a92c7799f193a"
format_stamp: "Formatted at 2026-08-10 06:31:14 on dist-test-slave-7lbf"
server_key: "0840403f3e07bf11c9eb1c2ee936206e"
server_key_iv: "2e31b85ed384a37a3dfa2a4fab64fcb6"
server_key_version: "encryptionkey@0"
I20260810 06:31:14.204524 6089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "d74a56e449664a7ebd4a92c7799f193a"
format_stamp: "Formatted at 2026-08-10 06:31:14 on dist-test-slave-7lbf"
server_key: "0840403f3e07bf11c9eb1c2ee936206e"
server_key_iv: "2e31b85ed384a37a3dfa2a4fab64fcb6"
server_key_version: "encryptionkey@0"
I20260810 06:31:14.208849 6089 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:31:14.211889 6107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:14.213239 6089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:31:14.213363 6089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "d74a56e449664a7ebd4a92c7799f193a"
format_stamp: "Formatted at 2026-08-10 06:31:14 on dist-test-slave-7lbf"
server_key: "0840403f3e07bf11c9eb1c2ee936206e"
server_key_iv: "2e31b85ed384a37a3dfa2a4fab64fcb6"
server_key_version: "encryptionkey@0"
I20260810 06:31:14.213500 6089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:14.218843 6089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:14.219554 6089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:14.219731 6089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:14.220359 6089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:14.221411 6089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:14.221462 6089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:14.221503 6089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:14.221551 6089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:14.231285 6089 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:36293
I20260810 06:31:14.231307 6291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:36293 every 8 connection(s)
I20260810 06:31:14.232343 6089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:31:14.234459 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 6089
I20260810 06:31:14.234563 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:31:14.234843 22287 external_mini_cluster.cc:1428] Setting key 226a6a15142d953be3c13604c31c0a44
I20260810 06:31:14.239567 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:14.234480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:34517 (local address 127.21.195.254:40293)
0810 06:31:14.234649 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:14.234654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:14.236125 (+ 1471us) server_negotiation.cc:407] Connection header received
0810 06:31:14.237764 (+ 1639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:14.237768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:14.237814 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:14.237887 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:14.239083 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:14.239087 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:14.239090 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:31:14.239104 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:14.239127 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:31:14.239135 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:14.239213 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:14.239357 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 06:31:14.239419 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 06:31:14.240559 6296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:14.235032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:40293 (local address 127.21.195.195:34517)
0810 06:31:14.235963 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:14.236029 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:14.237508 (+ 1479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:14.238092 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:14.238101 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:14.238205 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:14.238776 (+ 571us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:31:14.238778 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:14.238827 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:31:14.238928 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:14.239209 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:14.239219 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:14.239226 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:31:14.239407 (+ 181us) client_negotiation.cc:240] Negotiation successful
0810 06:31:14.239699 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":148,"threads_started":1}
I20260810 06:31:14.241899 6292 heartbeater.cc:347] Connected to a master server at 127.21.195.254:40293
I20260810 06:31:14.242166 6292 heartbeater.cc:464] Registering TS with master...
I20260810 06:31:14.242625 6292 heartbeater.cc:511] Master 127.21.195.254:40293 requested a full tablet report, sending...
I20260810 06:31:14.243759 5579 ts_manager.cc:194] Registered new tserver with Master: d74a56e449664a7ebd4a92c7799f193a (127.21.195.195:36293)
I20260810 06:31:14.249310 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 06:31:14.252456 5640 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:31:14.251437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55868 (local address 127.21.195.254:40293)
0810 06:31:14.251596 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:14.251601 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:14.251795 (+ 194us) server_negotiation.cc:407] Connection header received
0810 06:31:14.251928 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:14.251931 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:14.251972 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:14.252050 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:14.252323 (+ 273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55868: BlockingRecv error: recv got EOF from 127.0.0.1:55868 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 06:31:14.252602 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 5674
I20260810 06:31:14.274049 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 5889
I20260810 06:31:14.315805 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 6089
I20260810 06:31:14.366477 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 5532
2026-08-10T06:31:14Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (998 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:31:14 dist-test-slave-7lbf krb5kdc[6309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:31:14 dist-test-slave-7lbf krb5kdc[6309](info): set up 2 sockets
Aug 10 06:31:14 dist-test-slave-7lbf krb5kdc[6309](info): commencing operation
krb5kdc: starting...
W20260810 06:31:15.553967 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:31:15 dist-test-slave-7lbf krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:31:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:31:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:31:15.687265 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44425
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:45345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:44425
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:31:15.811774 6325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:15.812103 6325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:15.812146 6325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:15.816301 6325 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:31:15.816375 6325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:15.816393 6325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:15.816411 6325 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:31:15.816425 6325 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:31:15.822232 6325 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:45345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:44425
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:15.823441 6325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:15.824548 6325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:15.834034 6336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:15.834010 6339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:15.834014 6332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:15.834301 6325 server_base.cc:1034] running on GCE node
I20260810 06:31:15.835144 6325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:15.836447 6325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:15.837574 6325 hybrid_clock.cc:648] HybridClock initialized: now 1786343475837539 us; error 67 us; skew 500 ppm
Aug 10 06:31:15 dist-test-slave-7lbf krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343475, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:31:15.840735 6325 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:31:15.841926 6325 webserver.cc:460] Webserver started at http://127.21.195.254:43611/ using document root <none> and password file <none>
I20260810 06:31:15.842602 6325 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:15.842685 6325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:15.842911 6325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:15.845320 6325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "1867309ad8e9432895be32b6c49c7d88"
format_stamp: "Formatted at 2026-08-10 06:31:15 on dist-test-slave-7lbf"
server_key: "0d94ca7f722df549cd9089e2f2103b12"
server_key_iv: "bf34cbda279839863329788c88cc8d93"
server_key_version: "encryptionkey@0"
I20260810 06:31:15.846016 6325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "1867309ad8e9432895be32b6c49c7d88"
format_stamp: "Formatted at 2026-08-10 06:31:15 on dist-test-slave-7lbf"
server_key: "0d94ca7f722df549cd9089e2f2103b12"
server_key_iv: "bf34cbda279839863329788c88cc8d93"
server_key_version: "encryptionkey@0"
I20260810 06:31:15.850584 6325 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:31:15.853390 6355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:15.854913 6325 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:31:15.855062 6325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "1867309ad8e9432895be32b6c49c7d88"
format_stamp: "Formatted at 2026-08-10 06:31:15 on dist-test-slave-7lbf"
server_key: "0d94ca7f722df549cd9089e2f2103b12"
server_key_iv: "bf34cbda279839863329788c88cc8d93"
server_key_version: "encryptionkey@0"
I20260810 06:31:15.855190 6325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:15.870767 6325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:15.874310 6325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:15.874531 6325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:15.882391 6325 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:44425
I20260810 06:31:15.882455 6444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:44425 every 8 connection(s)
I20260810 06:31:15.883556 6325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:31:15.885749 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 6325
I20260810 06:31:15.885869 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:31:15.886154 22287 external_mini_cluster.cc:1428] Setting key 27bee0555807df63e7baa3c8d83a1138
I20260810 06:31:15.887168 6448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:31:15.894661 6448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88: Bootstrap starting.
Aug 10 06:31:15 dist-test-slave-7lbf krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343475, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:31:15.897662 6448 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88: Neither blocks nor log segments found. Creating new log.
I20260810 06:31:15.898499 6448 log.cc:824] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88: Log is configured to *not* fsync() on all Append() calls
I20260810 06:31:15.901113 6448 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88: No bootstrap required, opened a new log
I20260810 06:31:15.902073 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:15.887718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42710 (local address 127.21.195.254:44425)
0810 06:31:15.888168 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:15.888185 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:15.888225 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:31:15.888923 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:15.888943 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:15.889324 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:15.889694 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:15.890643 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:15.891741 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:15.892925 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:15.893469 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:15.893684 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:15.896727 (+ 3043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:15.896733 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:15.896750 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:31:15.896788 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:15.898571 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:15.899075 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:15.899081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:15.899088 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:15.899221 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:15.899542 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:15.899545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:15.899547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:15.900124 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:15.900348 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:15.900602 (+ 254us) server_negotiation.cc:299] Negotiation successful
0810 06:31:15.900965 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":128,"threads_started":1}
I20260810 06:31:15.905696 6448 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1867309ad8e9432895be32b6c49c7d88" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44425 } }
I20260810 06:31:15.905985 6448 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:31:15.906036 6448 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1867309ad8e9432895be32b6c49c7d88, State: Initialized, Role: FOLLOWER
I20260810 06:31:15.906495 6448 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1867309ad8e9432895be32b6c49c7d88" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44425 } }
I20260810 06:31:15.906641 6448 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:31:15.906690 6448 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:31:15.906773 6448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:31:15.907824 6448 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1867309ad8e9432895be32b6c49c7d88" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44425 } }
I20260810 06:31:15.908207 6448 leader_election.cc:302] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1867309ad8e9432895be32b6c49c7d88; no voters:
I20260810 06:31:15.908564 6448 leader_election.cc:288] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:31:15.908700 6457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:31:15.908921 6457 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [term 1 LEADER]: Becoming Leader. State: Replica: 1867309ad8e9432895be32b6c49c7d88, State: Running, Role: LEADER
I20260810 06:31:15.909298 6457 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1867309ad8e9432895be32b6c49c7d88" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44425 } }
I20260810 06:31:15.910159 6448 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:31:15.911281 6460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1867309ad8e9432895be32b6c49c7d88. Latest consensus state: current_term: 1 leader_uuid: "1867309ad8e9432895be32b6c49c7d88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1867309ad8e9432895be32b6c49c7d88" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44425 } } }
I20260810 06:31:15.911432 6460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [sys.catalog]: This master's current role is: LEADER
I20260810 06:31:15.911592 6458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1867309ad8e9432895be32b6c49c7d88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1867309ad8e9432895be32b6c49c7d88" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44425 } } }
I20260810 06:31:15.911679 6458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88 [sys.catalog]: This master's current role is: LEADER
I20260810 06:31:15.911861 6471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:31:15.915243 6471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:31:15.921099 6471 catalog_manager.cc:1347] Generated new cluster ID: c59836961a5e47df8d8a0030a4e7b375
I20260810 06:31:15.921196 6471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:31:15.940488 6471 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:31:15.941615 6471 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:31:15.948693 6471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88: Generated new TSK 0
I20260810 06:31:15.949777 6471 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:31:15.992213 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44425
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:45345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:31:16.117965 6491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:16.118299 6491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:16.118345 6491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:16.122692 6491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:16.122776 6491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:16.122844 6491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:31:16.128577 6491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:45345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:16.129895 6491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:16.131062 6491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:16.141781 6508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:16.141943 6491 server_base.cc:1034] running on GCE node
W20260810 06:31:16.141784 6500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:16.141819 6503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:16.142632 6491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:16.143381 6491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:16.144551 6491 hybrid_clock.cc:648] HybridClock initialized: now 1786343476144531 us; error 38 us; skew 500 ppm
Aug 10 06:31:16 dist-test-slave-7lbf krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343476, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:31:16.147657 6491 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:31:16.148692 6491 webserver.cc:460] Webserver started at http://127.21.195.193:35131/ using document root <none> and password file <none>
I20260810 06:31:16.149334 6491 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:16.149411 6491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:16.149672 6491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:16.151994 6491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "8c6d18aa0d624fb8919f33888edeaff0"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "7b387bc19ed3158ce8ff6f9c24d58172"
server_key_iv: "5858ad06f8debf75dfdcf32e067fb8b6"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.152619 6491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "8c6d18aa0d624fb8919f33888edeaff0"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "7b387bc19ed3158ce8ff6f9c24d58172"
server_key_iv: "5858ad06f8debf75dfdcf32e067fb8b6"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.156904 6491 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 06:31:16.159983 6520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.161612 6491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:31:16.161741 6491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "8c6d18aa0d624fb8919f33888edeaff0"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "7b387bc19ed3158ce8ff6f9c24d58172"
server_key_iv: "5858ad06f8debf75dfdcf32e067fb8b6"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.161873 6491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:16.174213 6491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:16.177657 6491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:16.177860 6491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:16.178540 6491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:16.179479 6491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:16.179531 6491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.179579 6491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:16.179608 6491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.188977 6491 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:35955
I20260810 06:31:16.189011 6693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:35955 every 8 connection(s)
I20260810 06:31:16.190074 6491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:31:16.190600 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 6491
I20260810 06:31:16.190721 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:31:16.191023 22287 external_mini_cluster.cc:1428] Setting key 511251ebb4f93fa6c2d545b60effab58
Aug 10 06:31:16 dist-test-slave-7lbf krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343476, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:31:16.206415 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.192363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:35947 (local address 127.21.195.254:44425)
0810 06:31:16.192482 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:16.192487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:16.193736 (+ 1249us) server_negotiation.cc:407] Connection header received
0810 06:31:16.195450 (+ 1714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:16.195453 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:16.195507 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:16.195582 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:16.197218 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.198105 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.199343 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.199727 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.199845 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.202553 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:16.202557 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:16.202560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:31:16.202596 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:16.204079 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:16.204648 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:16.204651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:16.204653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:16.204747 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:16.205106 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:16.205109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:16.205110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:16.205352 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:16.205449 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:16.206073 (+ 624us) server_negotiation.cc:299] Negotiation successful
0810 06:31:16.206233 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 06:31:16.207582 6698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.192945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44425 (local address 127.21.195.193:35947)
0810 06:31:16.193572 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:16.193633 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:16.195159 (+ 1526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:16.195828 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:16.195839 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:16.196411 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:16.197023 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.197041 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.198238 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.198241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.199197 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.199208 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.199887 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.199890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.200066 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.200724 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:16.200744 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:16.202343 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:16.204196 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:31:16.204203 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:31:16.204220 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:31:16.204533 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:31:16.204827 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:31:16.204829 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:31:16.204830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:31:16.204993 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:31:16.205476 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:16.205485 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:16.205806 (+ 321us) client_negotiation.cc:769] Sending connection context
0810 06:31:16.206003 (+ 197us) client_negotiation.cc:240] Negotiation successful
0810 06:31:16.206395 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":171,"threads_started":1}
I20260810 06:31:16.209182 6694 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44425
I20260810 06:31:16.209466 6694 heartbeater.cc:464] Registering TS with master...
I20260810 06:31:16.210103 6694 heartbeater.cc:511] Master 127.21.195.254:44425 requested a full tablet report, sending...
I20260810 06:31:16.212133 6385 ts_manager.cc:194] Registered new tserver with Master: 8c6d18aa0d624fb8919f33888edeaff0 (127.21.195.193:35955)
I20260810 06:31:16.213886 6385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:35947
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:31:16.222718 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44425
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:45345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:31:16.345922 6704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:16.346235 6704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:16.346278 6704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:16.350555 6704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:16.350631 6704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:16.350695 6704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:31:16.356428 6704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:45345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:16.357692 6704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:16.358814 6704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:16.369863 6713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:16.369866 6711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:16.369869 6710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:16.369930 6704 server_base.cc:1034] running on GCE node
I20260810 06:31:16.370551 6704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:16.371311 6704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:16.372475 6704 hybrid_clock.cc:648] HybridClock initialized: now 1786343476372441 us; error 50 us; skew 500 ppm
Aug 10 06:31:16 dist-test-slave-7lbf krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343476, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:31:16.375523 6704 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:31:16.376533 6704 webserver.cc:460] Webserver started at http://127.21.195.194:41221/ using document root <none> and password file <none>
I20260810 06:31:16.377146 6704 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:16.377211 6704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:16.377408 6704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:16.379751 6704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "f8669cc4b8a34fb49e725d310cd65e4c"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "62fbe092744a9547776d837f31a8ea30"
server_key_iv: "c86accd28b2654c1f15577b8278729ad"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.380332 6704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "f8669cc4b8a34fb49e725d310cd65e4c"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "62fbe092744a9547776d837f31a8ea30"
server_key_iv: "c86accd28b2654c1f15577b8278729ad"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.384613 6704 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 06:31:16.387501 6729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.388912 6704 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:31:16.389046 6704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "f8669cc4b8a34fb49e725d310cd65e4c"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "62fbe092744a9547776d837f31a8ea30"
server_key_iv: "c86accd28b2654c1f15577b8278729ad"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.389173 6704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:16.411252 6704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:16.414610 6704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:16.414815 6704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:16.415491 6704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:16.416465 6704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:16.416515 6704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.416561 6704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:16.416592 6704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.425657 6704 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:46143
I20260810 06:31:16.425680 6903 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:46143 every 8 connection(s)
I20260810 06:31:16.426733 6704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:31:16.431401 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 6704
I20260810 06:31:16.431529 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:31:16.431847 22287 external_mini_cluster.cc:1428] Setting key 48d1cab85e60bf6d5d47a9551b82c01a
Aug 10 06:31:16 dist-test-slave-7lbf krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343476, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:31:16.442785 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.428713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:54049 (local address 127.21.195.254:44425)
0810 06:31:16.428891 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:16.428896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:16.429899 (+ 1003us) server_negotiation.cc:407] Connection header received
0810 06:31:16.431438 (+ 1539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:16.431442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:16.431499 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:16.431595 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:16.433120 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.433779 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.435431 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.435775 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.435875 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.438704 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:16.438710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:16.438713 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:31:16.438748 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:16.440322 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:16.440890 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:16.440895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:16.440897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:16.441007 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:16.441402 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:16.441405 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:16.441407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:16.441754 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:16.441866 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:16.442430 (+ 564us) server_negotiation.cc:299] Negotiation successful
0810 06:31:16.442593 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:31:16.443717 6908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.429192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44425 (local address 127.21.195.194:54049)
0810 06:31:16.429744 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:16.429793 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:16.431189 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:16.431818 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:16.431828 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:16.432341 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:16.432966 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.432982 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.433920 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.433924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.435303 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.435314 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.435932 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.435935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.436105 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.436703 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:16.436722 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:16.438466 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:16.440453 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:31:16.440461 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:31:16.440479 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:31:16.440784 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:31:16.441125 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:31:16.441129 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:31:16.441131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:31:16.441304 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:31:16.441857 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:16.441863 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:16.442159 (+ 296us) client_negotiation.cc:769] Sending connection context
0810 06:31:16.442340 (+ 181us) client_negotiation.cc:240] Negotiation successful
0810 06:31:16.442675 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":138,"threads_started":1}
I20260810 06:31:16.445025 6904 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44425
I20260810 06:31:16.445355 6904 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:31:16.446012 6904 heartbeater.cc:511] Master 127.21.195.254:44425 requested a full tablet report, sending...
I20260810 06:31:16.447346 6385 ts_manager.cc:194] Registered new tserver with Master: f8669cc4b8a34fb49e725d310cd65e4c (127.21.195.194:46143)
I20260810 06:31:16.448159 6385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:54049
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:31:16.462384 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44425
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:45345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:31:16.585623 6912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:31:16.585971 6912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:31:16.586037 6912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:31:16.590314 6912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:31:16.590405 6912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:31:16.590490 6912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:31:16.596362 6912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:45345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:31:16.597718 6912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:31:16.598898 6912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:31:16.610334 6926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:31:16.610351 6929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:16.610668 6912 server_base.cc:1034] running on GCE node
W20260810 06:31:16.610338 6927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:31:16.611284 6912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:31:16.612156 6912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:31:16.613334 6912 hybrid_clock.cc:648] HybridClock initialized: now 1786343476613299 us; error 53 us; skew 500 ppm
Aug 10 06:31:16 dist-test-slave-7lbf krb5kdc[6309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343476, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:31:16.616560 6912 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:31:16.617699 6912 webserver.cc:460] Webserver started at http://127.21.195.195:37033/ using document root <none> and password file <none>
I20260810 06:31:16.618347 6912 fs_manager.cc:359] Metadata directory not provided
I20260810 06:31:16.618431 6912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:31:16.618667 6912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:31:16.621043 6912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "2c5515147731459aacbe5e386db97be6"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "1821b5208160625debf809a951f7a9d6"
server_key_iv: "e8dfecec8388fd672fed0298f3ebb4f2"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.621793 6912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "2c5515147731459aacbe5e386db97be6"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "1821b5208160625debf809a951f7a9d6"
server_key_iv: "e8dfecec8388fd672fed0298f3ebb4f2"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.626183 6912 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 06:31:16.629042 6939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.630470 6912 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:31:16.630648 6912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "2c5515147731459aacbe5e386db97be6"
format_stamp: "Formatted at 2026-08-10 06:31:16 on dist-test-slave-7lbf"
server_key: "1821b5208160625debf809a951f7a9d6"
server_key_iv: "e8dfecec8388fd672fed0298f3ebb4f2"
server_key_version: "encryptionkey@0"
I20260810 06:31:16.630771 6912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:31:16.675238 6912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:31:16.678885 6912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:31:16.679065 6912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:31:16.679669 6912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:31:16.680655 6912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:31:16.680709 6912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.680754 6912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:31:16.680774 6912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:31:16.689877 6912 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:39071
I20260810 06:31:16.689899 7116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:39071 every 8 connection(s)
I20260810 06:31:16.690990 6912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:31:16.700737 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 6912
I20260810 06:31:16.700861 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:31:16.701149 22287 external_mini_cluster.cc:1428] Setting key 320b9f0aab4a4877c1d223837bdd83fc
Aug 10 06:31:16 dist-test-slave-7lbf krb5kdc[6309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343476, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:31:16.706377 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.693211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:41191 (local address 127.21.195.254:44425)
0810 06:31:16.693405 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:16.693408 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:16.694479 (+ 1071us) server_negotiation.cc:407] Connection header received
0810 06:31:16.696021 (+ 1542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:16.696025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:16.696090 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:16.696169 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:16.697622 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.698180 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.699431 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.699664 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.699765 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.702895 (+ 3130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:16.702900 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:16.702903 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:31:16.702933 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:16.704370 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:16.704898 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:16.704900 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:16.704902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:16.704996 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:16.705285 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:16.705287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:16.705288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:16.705478 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:16.705612 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:16.706129 (+ 517us) server_negotiation.cc:299] Negotiation successful
0810 06:31:16.706242 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260810 06:31:16.707379 7119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.693735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44425 (local address 127.21.195.195:41191)
0810 06:31:16.694296 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:16.694352 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:16.695757 (+ 1405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:16.696398 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:16.696406 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:16.696850 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:31:16.697420 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.697447 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.698325 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.698328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.699285 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.699297 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.699838 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.699843 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.700053 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.700714 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:31:16.700734 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:31:16.702705 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:31:16.704491 (+ 1786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:31:16.704498 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:31:16.704514 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:31:16.704811 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:31:16.705064 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:31:16.705067 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:31:16.705068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:31:16.705213 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:31:16.705617 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:31:16.705623 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:31:16.705902 (+ 279us) client_negotiation.cc:769] Sending connection context
0810 06:31:16.706074 (+ 172us) client_negotiation.cc:240] Negotiation successful
0810 06:31:16.706359 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":159,"threads_started":1}
I20260810 06:31:16.708629 7117 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44425
I20260810 06:31:16.708897 7117 heartbeater.cc:464] Registering TS with master...
I20260810 06:31:16.709466 7117 heartbeater.cc:511] Master 127.21.195.254:44425 requested a full tablet report, sending...
I20260810 06:31:16.710685 6385 ts_manager.cc:194] Registered new tserver with Master: 2c5515147731459aacbe5e386db97be6 (127.21.195.195:39071)
I20260810 06:31:16.711330 6385 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:41191
I20260810 06:31:16.715272 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:31:16.724395 6455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.717213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42718 (local address 127.21.195.254:44425)
0810 06:31:16.717343 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:16.717347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:16.717556 (+ 209us) server_negotiation.cc:407] Connection header received
0810 06:31:16.717704 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:16.717706 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:16.717750 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:16.717818 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:31:16.718502 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.719027 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.719787 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.720001 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.720071 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.721441 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:31:16.721445 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:31:16.721447 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:31:16.721484 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:31:16.722759 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:16.723165 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:16.723167 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:16.723168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:16.723244 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:31:16.723448 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:31:16.723450 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:31:16.723451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:31:16.723685 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:31:16.723790 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:16.724042 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 06:31:16.724189 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:31:16.727651 6385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42718:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:31:16.730954 6385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:31:16.746928 7140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.740892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41388 (local address 127.21.195.194:46143)
0810 06:31:16.741695 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:16.741708 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:16.741736 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:31:16.741819 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:16.741824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:16.742249 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:16.742417 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:31:16.742618 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.743764 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.745258 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.746130 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.746442 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.746588 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:16.746644 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:31:16.746754 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":127,"threads_started":1}
I20260810 06:31:16.746920 7138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.740493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46143 (local address 127.0.0.1:41388)
0810 06:31:16.741165 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:16.741203 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:16.741361 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:16.742410 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:16.742413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:16.742427 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:31:16.742519 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.742525 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.743902 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.743905 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.745136 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.745143 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.746277 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.746280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.746442 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.746491 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 06:31:16.746597 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 06:31:16.746737 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":94,"spinlock_wait_cycles":30208,"thread_start_us":126,"threads_started":1}
I20260810 06:31:16.746932 7133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.740413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:39071 (local address 127.0.0.1:45368)
0810 06:31:16.741143 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:16.741203 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:16.741361 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:16.742240 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:16.742246 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:16.742271 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:31:16.742428 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.742436 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.743597 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.743600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.745119 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.745131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.746585 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.746588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.746669 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.746688 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 06:31:16.746764 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 06:31:16.746835 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":99,"spinlock_wait_cycles":6144,"thread_start_us":88,"threads_started":1}
I20260810 06:31:16.747265 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.740546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45368 (local address 127.21.195.195:39071)
0810 06:31:16.741700 (+ 1154us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:16.741716 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:16.741739 (+ 23us) server_negotiation.cc:407] Connection header received
0810 06:31:16.741818 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:16.741823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:16.742065 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:16.742237 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:31:16.742546 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.743478 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.745642 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.746464 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.746589 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.746699 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:16.746796 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 06:31:16.746884 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1045,"thread_start_us":188,"threads_started":1}
I20260810 06:31:16.747730 7142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.741213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35955 (local address 127.0.0.1:41990)
0810 06:31:16.742093 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:16.742104 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:16.742201 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:16.742979 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:16.742981 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:16.743000 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:31:16.743101 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.743106 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.744306 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.744309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.745345 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:16.745356 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.746228 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.746232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:16.747411 (+ 1179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.747435 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 06:31:16.747510 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 06:31:16.747588 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"mutex_wait_us":50,"thread_start_us":99,"threads_started":1}
I20260810 06:31:16.747823 7144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:16.741664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41990 (local address 127.21.195.193:35955)
0810 06:31:16.742056 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:16.742063 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:16.742569 (+ 506us) server_negotiation.cc:407] Connection header received
0810 06:31:16.742654 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:16.742659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:16.742843 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:16.742999 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:31:16.743196 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.744173 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.745472 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:16.746106 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:16.746229 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:16.746389 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:16.747555 (+ 1166us) server_negotiation.cc:299] Negotiation successful
0810 06:31:16.747670 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":111,"threads_started":1}
I20260810 06:31:16.750840 6594 tablet_service.cc:1467] Processing CreateTablet for tablet 4df4935a57994d76ba4d3d3782cc0474 (DEFAULT_TABLE table=test-table [id=27a97398b26c4b34a1fdabd09e411a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:31:16.750681 6803 tablet_service.cc:1467] Processing CreateTablet for tablet 4df4935a57994d76ba4d3d3782cc0474 (DEFAULT_TABLE table=test-table [id=27a97398b26c4b34a1fdabd09e411a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:31:16.750681 7009 tablet_service.cc:1467] Processing CreateTablet for tablet 4df4935a57994d76ba4d3d3782cc0474 (DEFAULT_TABLE table=test-table [id=27a97398b26c4b34a1fdabd09e411a0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:31:16.751920 6594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df4935a57994d76ba4d3d3782cc0474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:31:16.751936 7009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df4935a57994d76ba4d3d3782cc0474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:31:16.751928 6803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4df4935a57994d76ba4d3d3782cc0474. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:31:16.759384 7145 tablet_bootstrap.cc:492] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0: Bootstrap starting.
I20260810 06:31:16.761409 7147 tablet_bootstrap.cc:492] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Bootstrap starting.
I20260810 06:31:16.761914 7148 tablet_bootstrap.cc:492] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Bootstrap starting.
I20260810 06:31:16.762274 7145 tablet_bootstrap.cc:654] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0: Neither blocks nor log segments found. Creating new log.
I20260810 06:31:16.763293 7145 log.cc:824] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0: Log is configured to *not* fsync() on all Append() calls
I20260810 06:31:16.763969 7148 tablet_bootstrap.cc:654] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Neither blocks nor log segments found. Creating new log.
I20260810 06:31:16.764420 7147 tablet_bootstrap.cc:654] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Neither blocks nor log segments found. Creating new log.
I20260810 06:31:16.765316 7148 log.cc:824] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Log is configured to *not* fsync() on all Append() calls
I20260810 06:31:16.765414 7147 log.cc:824] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:31:16.766657 7145 tablet_bootstrap.cc:492] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0: No bootstrap required, opened a new log
I20260810 06:31:16.766911 7145 ts_tablet_manager.cc:1397] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260810 06:31:16.767421 7147 tablet_bootstrap.cc:492] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: No bootstrap required, opened a new log
I20260810 06:31:16.767627 7147 ts_tablet_manager.cc:1397] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260810 06:31:16.767817 7148 tablet_bootstrap.cc:492] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: No bootstrap required, opened a new log
I20260810 06:31:16.768028 7148 ts_tablet_manager.cc:1397] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:31:16.770810 7147 raft_consensus.cc:348] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:16.771298 7147 raft_consensus.cc:374] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:31:16.771422 7147 raft_consensus.cc:729] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8669cc4b8a34fb49e725d310cd65e4c, State: Initialized, Role: FOLLOWER
I20260810 06:31:16.771817 7145 raft_consensus.cc:348] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:16.771943 7148 raft_consensus.cc:348] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:16.772135 7145 raft_consensus.cc:374] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:31:16.772154 7148 raft_consensus.cc:374] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:31:16.772073 7147 consensus_queue.cc:260] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:16.772197 7148 raft_consensus.cc:729] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c5515147731459aacbe5e386db97be6, State: Initialized, Role: FOLLOWER
I20260810 06:31:16.772260 7145 raft_consensus.cc:729] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c6d18aa0d624fb8919f33888edeaff0, State: Initialized, Role: FOLLOWER
I20260810 06:31:16.772715 7145 consensus_queue.cc:260] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:16.772949 6904 heartbeater.cc:503] Master 127.21.195.254:44425 was elected leader, sending a full tablet report...
I20260810 06:31:16.773484 6694 heartbeater.cc:503] Master 127.21.195.254:44425 was elected leader, sending a full tablet report...
I20260810 06:31:16.773944 7145 ts_tablet_manager.cc:1428] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260810 06:31:16.772716 7148 consensus_queue.cc:260] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:16.774854 7117 heartbeater.cc:503] Master 127.21.195.254:44425 was elected leader, sending a full tablet report...
I20260810 06:31:16.773316 7147 ts_tablet_manager.cc:1428] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260810 06:31:16.776116 7148 ts_tablet_manager.cc:1428] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260810 06:31:16.928264 6907 tablet.cc:2369] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:31:16.941680 6696 tablet.cc:2369] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:31:16.942159 7118 tablet.cc:2369] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:31:17.069680 7157 raft_consensus.cc:482] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:31:17.070009 7157 raft_consensus.cc:504] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:17.071357 7157 leader_election.cc:288] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c5515147731459aacbe5e386db97be6 (127.21.195.195:39071), f8669cc4b8a34fb49e725d310cd65e4c (127.21.195.194:46143)
I20260810 06:31:17.075533 7140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:17.071781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:47141 (local address 127.21.195.194:46143)
0810 06:31:17.071935 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:17.071939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:17.072232 (+ 293us) server_negotiation.cc:407] Connection header received
0810 06:31:17.072378 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:17.072382 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:17.072432 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:17.072502 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:31:17.072859 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.073366 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.074577 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.074980 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.075098 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:17.075158 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:17.075322 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 06:31:17.075402 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 06:31:17.075564 7162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:17.071700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46143 (local address 127.21.195.193:47141)
0810 06:31:17.072117 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:17.072130 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:17.072254 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:17.072527 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:17.072529 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:17.072545 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:31:17.072733 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:17.072739 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.073481 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.073484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:17.074440 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:17.074450 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.075100 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.075104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:17.075203 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:17.075226 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 06:31:17.075295 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 06:31:17.075382 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":64,"spinlock_wait_cycles":26496,"thread_start_us":154,"threads_started":1}
I20260810 06:31:17.075619 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:17.071781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:46807 (local address 127.21.195.195:39071)
0810 06:31:17.071918 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:17.071923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:17.072316 (+ 393us) server_negotiation.cc:407] Connection header received
0810 06:31:17.072424 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:17.072427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:17.072483 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:17.072557 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:31:17.072907 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.073426 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.074604 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.075031 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.075161 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:17.075222 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:17.075417 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 06:31:17.075503 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:31:17.075634 7159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:17.071700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:39071 (local address 127.21.195.193:46807)
0810 06:31:17.072184 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:17.072197 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:31:17.072323 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:31:17.072575 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:31:17.072578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:31:17.072623 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:31:17.072778 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:17.072784 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.073573 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.073577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:17.074452 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:31:17.074462 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.075161 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.075165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:31:17.075285 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:17.075306 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 06:31:17.075385 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 06:31:17.075462 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"mutex_wait_us":138,"spinlock_wait_cycles":2304,"thread_start_us":109,"threads_started":1}
I20260810 06:31:17.076395 7043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df4935a57994d76ba4d3d3782cc0474" candidate_uuid: "8c6d18aa0d624fb8919f33888edeaff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5515147731459aacbe5e386db97be6" is_pre_election: true
I20260810 06:31:17.076426 6834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df4935a57994d76ba4d3d3782cc0474" candidate_uuid: "8c6d18aa0d624fb8919f33888edeaff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" is_pre_election: true
I20260810 06:31:17.076735 6834 raft_consensus.cc:2454] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6d18aa0d624fb8919f33888edeaff0 in term 0.
I20260810 06:31:17.076735 7043 raft_consensus.cc:2454] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6d18aa0d624fb8919f33888edeaff0 in term 0.
I20260810 06:31:17.077282 6522 leader_election.cc:302] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c5515147731459aacbe5e386db97be6, 8c6d18aa0d624fb8919f33888edeaff0; no voters:
I20260810 06:31:17.077638 7157 raft_consensus.cc:2781] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:31:17.077733 7157 raft_consensus.cc:482] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:31:17.077780 7157 raft_consensus.cc:3037] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:31:17.078902 7157 raft_consensus.cc:504] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:17.079322 7157 leader_election.cc:288] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [CANDIDATE]: Term 1 election: Requested vote from peers 2c5515147731459aacbe5e386db97be6 (127.21.195.195:39071), f8669cc4b8a34fb49e725d310cd65e4c (127.21.195.194:46143)
I20260810 06:31:17.079816 6834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df4935a57994d76ba4d3d3782cc0474" candidate_uuid: "8c6d18aa0d624fb8919f33888edeaff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8669cc4b8a34fb49e725d310cd65e4c"
I20260810 06:31:17.079923 7043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df4935a57994d76ba4d3d3782cc0474" candidate_uuid: "8c6d18aa0d624fb8919f33888edeaff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c5515147731459aacbe5e386db97be6"
I20260810 06:31:17.079955 6834 raft_consensus.cc:3037] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:31:17.080070 7043 raft_consensus.cc:3037] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:31:17.081169 6834 raft_consensus.cc:2454] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6d18aa0d624fb8919f33888edeaff0 in term 1.
I20260810 06:31:17.081172 7043 raft_consensus.cc:2454] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6d18aa0d624fb8919f33888edeaff0 in term 1.
I20260810 06:31:17.081486 6523 leader_election.cc:302] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c6d18aa0d624fb8919f33888edeaff0, f8669cc4b8a34fb49e725d310cd65e4c; no voters:
I20260810 06:31:17.081692 7157 raft_consensus.cc:2781] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:31:17.081954 7157 raft_consensus.cc:686] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [term 1 LEADER]: Becoming Leader. State: Replica: 8c6d18aa0d624fb8919f33888edeaff0, State: Running, Role: LEADER
I20260810 06:31:17.082381 7157 consensus_queue.cc:237] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } }
I20260810 06:31:17.085884 6384 catalog_manager.cc:5495] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c6d18aa0d624fb8919f33888edeaff0 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "8c6d18aa0d624fb8919f33888edeaff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6d18aa0d624fb8919f33888edeaff0" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35955 } health_report { overall_health: HEALTHY } } }
I20260810 06:31:17.114086 7144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:17.110176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41998 (local address 127.21.195.193:35955)
0810 06:31:17.110334 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:31:17.110338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:31:17.110353 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:31:17.110437 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:31:17.110439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:31:17.110516 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:31:17.110619 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:31:17.110867 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.111406 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.112364 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:31:17.112595 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:31:17.112691 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:31:17.113068 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:31:17.113670 (+ 602us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:31:17.113792 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 06:31:17.113863 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 06:31:17.113932 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:31:17.120957 6834 raft_consensus.cc:1261] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 1 FOLLOWER]: Refusing update from remote peer 8c6d18aa0d624fb8919f33888edeaff0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:31:17.120958 7043 raft_consensus.cc:1261] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 1 FOLLOWER]: Refusing update from remote peer 8c6d18aa0d624fb8919f33888edeaff0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:31:17.121771 7164 consensus_queue.cc:1035] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8669cc4b8a34fb49e725d310cd65e4c" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:31:17.121996 7157 consensus_queue.cc:1035] T 4df4935a57994d76ba4d3d3782cc0474 P 8c6d18aa0d624fb8919f33888edeaff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c5515147731459aacbe5e386db97be6" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 39071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:31:17.131094 7170 mvcc.cc:205] Tried to move back new op lower bound from 7316862882278899712 to 7316862882132242432. Current Snapshot: MvccSnapshot[applied={T|T < 7316862882278899712}]
I20260810 06:31:17.141446 6385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:31:17.141685 6385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42718:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:31:17.144532 6385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1867309ad8e9432895be32b6c49c7d88: Sending DeleteTablet for 3 replicas of tablet 4df4935a57994d76ba4d3d3782cc0474
I20260810 06:31:17.145653 6803 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df4935a57994d76ba4d3d3782cc0474 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:31:17 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:41388
I20260810 06:31:17.145815 7009 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df4935a57994d76ba4d3d3782cc0474 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:31:17 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:45368
I20260810 06:31:17.146307 6594 tablet_service.cc:1514] Processing DeleteTablet for tablet 4df4935a57994d76ba4d3d3782cc0474 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:31:17 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:41990
I20260810 06:31:17.146462 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 6491
I20260810 06:31:17.153039 7183 tablet_replica.cc:330] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: stopping tablet replica
I20260810 06:31:17.153045 7186 tablet_replica.cc:330] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: stopping tablet replica
I20260810 06:31:17.153468 7183 raft_consensus.cc:2229] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:31:17.153483 7186 raft_consensus.cc:2229] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:31:17.153925 7183 raft_consensus.cc:2258] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:31:17.153952 7186 raft_consensus.cc:2258] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:31:17.155614 7183 ts_tablet_manager.cc:1905] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:31:17.155664 7186 ts_tablet_manager.cc:1905] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:31:17.158265 7183 ts_tablet_manager.cc:1918] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:31:17.158396 7183 log.cc:1196] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/4df4935a57994d76ba4d3d3782cc0474
I20260810 06:31:17.158730 7183 ts_tablet_manager.cc:1939] T 4df4935a57994d76ba4d3d3782cc0474 P 2c5515147731459aacbe5e386db97be6: Deleting consensus metadata
I20260810 06:31:17.158825 7186 ts_tablet_manager.cc:1918] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:31:17.158951 7186 log.cc:1196] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/4df4935a57994d76ba4d3d3782cc0474
I20260810 06:31:17.159322 7186 ts_tablet_manager.cc:1939] T 4df4935a57994d76ba4d3d3782cc0474 P f8669cc4b8a34fb49e725d310cd65e4c: Deleting consensus metadata
I20260810 06:31:17.160269 6356 catalog_manager.cc:4841] TS 2c5515147731459aacbe5e386db97be6 (127.21.195.195:39071): tablet 4df4935a57994d76ba4d3d3782cc0474 (table test-table [id=27a97398b26c4b34a1fdabd09e411a0d]) successfully deleted
W20260810 06:31:17.160964 6358 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:35955 (error 108)
I20260810 06:31:17.161243 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 6704
I20260810 06:31:17.161559 6358 catalog_manager.cc:4841] TS f8669cc4b8a34fb49e725d310cd65e4c (127.21.195.194:46143): tablet 4df4935a57994d76ba4d3d3782cc0474 (table test-table [id=27a97398b26c4b34a1fdabd09e411a0d]) successfully deleted
I20260810 06:31:17.170046 7142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:31:17.169427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35955 (local address 127.0.0.1:42014)
0810 06:31:17.169777 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0810 06:31:17.169913 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209}
W20260810 06:31:17.170419 6358 catalog_manager.cc:4584] TS 8c6d18aa0d624fb8919f33888edeaff0 (127.21.195.193:35955): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4df4935a57994d76ba4d3d3782cc0474: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35955: connect: Connection refused (error 111)
I20260810 06:31:17.176546 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 6912
I20260810 06:31:17.197991 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 6325
2026-08-10T06:31:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2827 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:31:17 dist-test-slave-7lbf krb5kdc[7192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:31:17 dist-test-slave-7lbf krb5kdc[7192](info): set up 2 sockets
Aug 10 06:31:17 dist-test-slave-7lbf krb5kdc[7192](info): commencing operation
krb5kdc: starting...
W20260810 06:31:18.382593 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:31:18 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:31:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:31:18Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.21.195.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.21.195.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/rangeradmin_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/rangeradmin_127.21.195.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.21.195.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.21.195.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/rangerlookup_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/rangerlookup_127.21.195.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.195.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.21.195.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/HTTP_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/HTTP_127.21.195.212@KRBTEST.COM.keytab.
I20260810 06:31:18.593726 22287 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskvl7b6p/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/postgres -l logfile start
2026-08-10 06:31:21.506 UTC [7238] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 06:31:21.506 UTC [7238] LOG: listening on IPv4 address "127.21.195.212", port 49103
2026-08-10 06:31:21.509 UTC [7238] LOG: listening on Unix socket "/tmp/.s.PGSQL.49103"
2026-08-10 06:31:21.530 UTC [7245] LOG: database system was shut down at 2026-08-10 06:31:20 UTC
2026-08-10 06:31:21.533 UTC [7238] LOG: database system is ready to accept connections
I20260810 06:31:22.635385 22287 mini_postgres.cc:96] Postgres bound to 49103
2026-08-10 06:31:22.645 UTC [7260] FATAL: database "slave" does not exist
127.21.195.212:49103 - accepting connections
I20260810 06:31:22.646014 22287 mini_ranger.cc:161] Starting Ranger...
I20260810 06:31:22.664358 22287 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 06:31:23.105790 22287 mini_ranger.cc:87] Created ranger Postgres database
I20260810 06:31:23.105899 22287 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-admin
2026-08-10 06:31:23,451 [I] DB FLAVOR :POSTGRES
2026-08-10 06:31:23,452 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 06:31:23,452 [I] Checking connection..
2026-08-10 06:31:23,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 06:31:23,707 [I] Checking connection passed.
2026-08-10 06:31:23,708 [I] --------- Verifying version history table ---------
2026-08-10 06:31:23,708 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:31:23,982 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 06:31:23,983 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:31:24,257 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 06:31:24,257 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 06:31:24,257 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 06:31:24.520 UTC [7356] WARNING: there is no transaction in progress
2026-08-10 06:31:24,527 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 06:31:24,527 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:31:24,809 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 06:31:24,810 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 06:31:24,810 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 06:31:25,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 06:31:25,358 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7lbf.c.gcp-upstream.internal','N') ;"
2026-08-10 06:31:25,622 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 06:31:25,898 [I] Table x_portal_user does not exist in database ranger
2026-08-10 06:31:25,898 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 06:31:26,166 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 06:31:26,167 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 06:31:26,448 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 06:31:26,724 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 06:31:26,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 06:31:27.714 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.730 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.746 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.761 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.777 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.797 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.864 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.871 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.886 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.896 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.908 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.922 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.932 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.939 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.945 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:27.951 UTC [7550] WARNING: there is no transaction in progress
2026-08-10 06:31:28,554 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 06:31:28,554 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 06:31:28,813 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 06:31:28,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 06:31:29,092 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 06:31:29,093 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 06:31:29,394 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 06:31:29,395 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 06:31:29,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 06:31:29,934 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7lbf.c.gcp-upstream.internal';"
2026-08-10 06:31:30,203 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 06:31:30,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 06:31:30,468 [I] DB_PATCHES have already been applied
I20260810 06:31:30.475049 22287 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-admin:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskvl7b6p/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 06:31:30.475129 22287 mini_ranger.cc:193] Using host: 127.21.195.212
I20260810 06:31:30.479893 22287 mini_ranger.cc:227] Ranger admin URL: http://127.21.195.212:59971
Aug 10, 2026 6:31:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:31:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:31:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 6:31:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 6:31:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 6:31:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 6:31:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 06:31:31.756656 22287 mini_ranger.cc:160] Time spent starting Ranger: real 9.111s user 0.000s sys 0.013s
Aug 10, 2026 6:31:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 6:31:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 6:31:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 6:31:52 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 6:31:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 06:31:53.754491 22287 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.21.195.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.21.195.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/rangerkms_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/rangerkms_127.21.195.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.195.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.21.195.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.195.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/HTTP_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.195.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/HTTP_127.21.195.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 06:31:53 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343513, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 06:31:53.864686 22287 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 06:31:53.877632 22287 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 06:31:54.681789 22287 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 06:31:54.681902 22287 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms
I20260810 06:31:54.682015 22287 mini_ranger_kms.cc:227] Using postgres at 127.21.195.212:49103
2026-08-10 06:31:55,071 [I] DB FLAVOR :POSTGRES
2026-08-10 06:31:55,071 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 06:31:55,071 [I] Checking connection
2026-08-10 06:31:55,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 06:31:55,359 [I] connection success
2026-08-10 06:31:55,359 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 06:31:55,359 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 06:31:55,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 06:31:55,640 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 06:31:55,641 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 06:31:55,641 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 06:31:55,641 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:49103/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 06:31:55,919 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 06:31:56.437252 22287 mini_ranger_kms.cc:310] Created kms service
I20260810 06:31:56.646667 22287 mini_ranger_kms.cc:326] Created kudu user
I20260810 06:31:56.692638 22287 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 06:31:56 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343513, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:31:57.157053 22287 mini_ranger_kms.cc:384] Added ranger policy
I20260810 06:31:57.157228 22287 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms:/tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 06:31:57.157251 22287 mini_ranger_kms.cc:240] Using host: 127.21.195.212
I20260810 06:31:57.162897 22287 mini_ranger_kms.cc:276] Ranger KMS PID: 7837
I20260810 06:31:57.163044 22287 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.21.195.212:36173
Aug 10, 2026 6:31:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:31:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:31:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 6:31:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 6:31:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 6:31:58 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 06:31:59 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786343519, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.195.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:31:59.830627 22287 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.966s user 0.021s sys 0.348s
I20260810 06:31:59.830775 22287 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 06:31:59.830888 22287 mini_ranger_kms.cc:401] 127.21.195.212:36173/kms/v1/keys
Aug 10 06:32:00 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343519, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.195.212@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
Aug 10 06:32:00 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343519, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.195.212@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
Aug 10 06:32:02 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:32:03.022185 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46719
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:38139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:46719
--ranger_config_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:36173/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:32:03.163437 7919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:03.163786 7919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:03.163839 7919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:03.168278 7919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:32:03.168381 7919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:03.168403 7919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:03.168423 7919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:32:03.168440 7919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:32:03.174831 7919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:38139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/wal
--ranger_kms_url=127.21.195.212:36173/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:46719
--ranger_config_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:03.176097 7919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:03.177307 7919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:03.187633 7925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:03.187953 7926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:03.187628 7934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:03.188273 7919 server_base.cc:1034] running on GCE node
I20260810 06:32:03.188951 7919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:03.190412 7919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:03.191612 7919 hybrid_clock.cc:648] HybridClock initialized: now 1786343523191592 us; error 47 us; skew 500 ppm
Aug 10 06:32:03 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343523, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:03.195124 7919 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:32:03.196238 7919 webserver.cc:460] Webserver started at http://127.21.195.254:38073/ using document root <none> and password file <none>
I20260810 06:32:03.196862 7919 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:03.196935 7919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:03.197168 7919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:32:03 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343523, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:03.269958 7919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "2a6b11d0efa84b439d802c4085415e64"
format_stamp: "Formatted at 2026-08-10 06:32:03 on dist-test-slave-7lbf"
server_key: "d8d0f8f1c4938fa194f22f52d0075ec8"
server_key_iv: "a5e0975b71bbf5630b2867793f5d8ffc"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:03.270725 7919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "2a6b11d0efa84b439d802c4085415e64"
format_stamp: "Formatted at 2026-08-10 06:32:03 on dist-test-slave-7lbf"
server_key: "d8d0f8f1c4938fa194f22f52d0075ec8"
server_key_iv: "a5e0975b71bbf5630b2867793f5d8ffc"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:03.275432 7919 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:32:03.295094 7944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:03.296649 7919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:32:03.296820 7919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "2a6b11d0efa84b439d802c4085415e64"
format_stamp: "Formatted at 2026-08-10 06:32:03 on dist-test-slave-7lbf"
server_key: "d8d0f8f1c4938fa194f22f52d0075ec8"
server_key_iv: "a5e0975b71bbf5630b2867793f5d8ffc"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:03.296970 7919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:03.317068 7919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:03.320279 7919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:03.320488 7919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:03.331272 7919 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:46719
I20260810 06:32:03.331377 8019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:46719 every 8 connection(s)
I20260810 06:32:03.332469 7919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:32:03.332706 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 7919
I20260810 06:32:03.332844 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:32:03.333137 22287 external_mini_cluster.cc:1428] Setting key f2fad2dbeeb9a58bbed80578fa2d74e2
I20260810 06:32:03.336534 8020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:32:03.344558 8020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64: Bootstrap starting.
Aug 10 06:32:03 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:03.347596 8020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64: Neither blocks nor log segments found. Creating new log.
I20260810 06:32:03.349486 8020 log.cc:824] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:03.352059 8020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64: No bootstrap required, opened a new log
I20260810 06:32:03.352532 8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:03.334858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44070 (local address 127.21.195.254:46719)
0810 06:32:03.335557 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:03.335579 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:03.335920 (+ 341us) server_negotiation.cc:407] Connection header received
0810 06:32:03.337153 (+ 1233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:03.337183 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:03.337727 (+ 544us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:03.338160 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:03.339154 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:03.340750 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:03.342076 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:03.342808 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:03.342980 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:03.346255 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:03.346263 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:03.346282 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:03.346332 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:03.348566 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:03.349133 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:03.349140 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:03.349147 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:03.349328 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:03.349726 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:03.349730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:03.349731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:03.350386 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:03.350657 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:03.351008 (+ 351us) server_negotiation.cc:299] Negotiation successful
0810 06:32:03.351359 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":339,"threads_started":1}
I20260810 06:32:03.356017 8020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6b11d0efa84b439d802c4085415e64" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46719 } }
I20260810 06:32:03.356294 8020 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:32:03.356371 8020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a6b11d0efa84b439d802c4085415e64, State: Initialized, Role: FOLLOWER
I20260810 06:32:03.356822 8020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6b11d0efa84b439d802c4085415e64" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46719 } }
I20260810 06:32:03.356946 8020 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:32:03.357007 8020 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:32:03.357108 8020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:32:03.358196 8020 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6b11d0efa84b439d802c4085415e64" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46719 } }
I20260810 06:32:03.358564 8020 leader_election.cc:302] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a6b11d0efa84b439d802c4085415e64; no voters:
I20260810 06:32:03.358932 8020 leader_election.cc:288] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:32:03.359112 8029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:32:03.359459 8029 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [term 1 LEADER]: Becoming Leader. State: Replica: 2a6b11d0efa84b439d802c4085415e64, State: Running, Role: LEADER
I20260810 06:32:03.359897 8029 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6b11d0efa84b439d802c4085415e64" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46719 } }
I20260810 06:32:03.360471 8020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:32:03.362618 8031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a6b11d0efa84b439d802c4085415e64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6b11d0efa84b439d802c4085415e64" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46719 } } }
I20260810 06:32:03.362752 8031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [sys.catalog]: This master's current role is: LEADER
I20260810 06:32:03.363399 8034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a6b11d0efa84b439d802c4085415e64. Latest consensus state: current_term: 1 leader_uuid: "2a6b11d0efa84b439d802c4085415e64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a6b11d0efa84b439d802c4085415e64" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46719 } } }
I20260810 06:32:03.363498 8034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64 [sys.catalog]: This master's current role is: LEADER
I20260810 06:32:03.363788 8020 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 06:32:03.364306 8045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:32:03.371886 8045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:32:03.382675 8045 catalog_manager.cc:1347] Generated new cluster ID: 9ce60b2de2984862b8c5fe8eda444c3e
I20260810 06:32:03.382773 8045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:32:03.408267 8045 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:32:03.409936 8045 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:32:03.419938 8045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64: Generated new TSK 0
I20260810 06:32:03.421103 8045 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:32:04.224244 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:36173/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46719
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:38139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:32:04.409379 8087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:04.409794 8087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:04.409850 8087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:04.414407 8087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:04.414486 8087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:04.414554 8087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:32:04.423142 8087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:38139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.21.195.212:36173/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:04.424763 8087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:04.426360 8087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:04.440511 8103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:04.440603 8087 server_base.cc:1034] running on GCE node
W20260810 06:32:04.440742 8107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:04.440536 8099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:04.441291 8087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:04.442073 8087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:04.443255 8087 hybrid_clock.cc:648] HybridClock initialized: now 1786343524443225 us; error 50 us; skew 500 ppm
Aug 10 06:32:04 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:04.446314 8087 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:32:04.447445 8087 webserver.cc:460] Webserver started at http://127.21.195.193:46677/ using document root <none> and password file <none>
I20260810 06:32:04.448084 8087 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:04.448155 8087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:04.448369 8087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:32:04 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:04.467188 8087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "e43abe02c29649e38adcd320219e27c4"
format_stamp: "Formatted at 2026-08-10 06:32:04 on dist-test-slave-7lbf"
server_key: "5084ea38349d864a9658bf7d5275217c"
server_key_iv: "72f90e8e5df98ad35e2b83c84f8b8a6e"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:04.468060 8087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "e43abe02c29649e38adcd320219e27c4"
format_stamp: "Formatted at 2026-08-10 06:32:04 on dist-test-slave-7lbf"
server_key: "5084ea38349d864a9658bf7d5275217c"
server_key_iv: "72f90e8e5df98ad35e2b83c84f8b8a6e"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:04.474943 8087 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260810 06:32:04.511288 8122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:04.513460 8087 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.004s sys 0.001s
I20260810 06:32:04.513685 8087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "e43abe02c29649e38adcd320219e27c4"
format_stamp: "Formatted at 2026-08-10 06:32:04 on dist-test-slave-7lbf"
server_key: "5084ea38349d864a9658bf7d5275217c"
server_key_iv: "72f90e8e5df98ad35e2b83c84f8b8a6e"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:04.513917 8087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:04.551790 8087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:04.555472 8087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:04.555684 8087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:04.556563 8087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:04.557708 8087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:04.557766 8087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:04.557828 8087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:04.557881 8087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:04.572492 8087 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:41301
I20260810 06:32:04.573993 8087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:32:04.575778 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 8087
I20260810 06:32:04.575938 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:32:04.576210 8293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:41301 every 8 connection(s)
I20260810 06:32:04.576303 22287 external_mini_cluster.cc:1428] Setting key 7aaec0121eb7ac60bc729557785f0b56
Aug 10 06:32:04 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:32:04.597494 8297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:04.579373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:40931 (local address 127.21.195.254:46719)
0810 06:32:04.581163 (+ 1790us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:04.581167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:04.581796 (+ 629us) server_negotiation.cc:407] Connection header received
0810 06:32:04.583151 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:04.583154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:04.583219 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:04.583318 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:04.585610 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:04.586414 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:04.588427 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:04.588794 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:04.588920 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:04.592839 (+ 3919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:04.592844 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:04.592859 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:04.592897 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:04.594796 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:04.595389 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:04.595394 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:04.595396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:04.595503 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:04.595982 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:04.595985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:04.595987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:04.596249 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:04.596324 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:04.597133 (+ 809us) server_negotiation.cc:299] Negotiation successful
0810 06:32:04.597294 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1702,"thread_start_us":112,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:32:04.599576 8300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:04.579910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46719 (local address 127.21.195.193:40931)
0810 06:32:04.581504 (+ 1594us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:04.581678 (+ 174us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:04.582897 (+ 1219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:04.583706 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:04.583717 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:04.584384 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:04.585376 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:04.585402 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:04.586584 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:04.586588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:04.588258 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:04.588273 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:04.589150 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:04.589155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:04.589393 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:04.590238 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:04.590265 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:04.592548 (+ 2283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:04.594935 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:04.594943 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:04.594966 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:04.595268 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:04.595619 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:04.595622 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:04.595624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:04.595862 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:04.596414 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:04.596422 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:04.596798 (+ 376us) client_negotiation.cc:769] Sending connection context
0810 06:32:04.597817 (+ 1019us) client_negotiation.cc:240] Negotiation successful
0810 06:32:04.598259 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1338,"thread_start_us":257,"threads_started":1}
I20260810 06:32:04.602393 8294 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46719
I20260810 06:32:04.602696 8294 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:04.603293 8294 heartbeater.cc:511] Master 127.21.195.254:46719 requested a full tablet report, sending...
I20260810 06:32:04.605561 7966 ts_manager.cc:194] Registered new tserver with Master: e43abe02c29649e38adcd320219e27c4 (127.21.195.193:41301)
I20260810 06:32:04.607028 7966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:40931
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:32:04.623085 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:36173/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46719
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:38139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:32:04 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 06:32:04.797114 8303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:04.797694 8303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:04.797847 8303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:04.803419 8303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:04.803521 8303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:04.803625 8303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:32:04.811184 8303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:38139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.21.195.212:36173/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:04.812557 8303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:04.814091 8303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:04.826766 8314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:04.826761 8312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:04.827078 8311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:04.827419 8303 server_base.cc:1034] running on GCE node
I20260810 06:32:04.827996 8303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:04.828761 8303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:04.829953 8303 hybrid_clock.cc:648] HybridClock initialized: now 1786343524829923 us; error 52 us; skew 500 ppm
Aug 10 06:32:04 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:04.833726 8303 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:32:04.834944 8303 webserver.cc:460] Webserver started at http://127.21.195.194:38121/ using document root <none> and password file <none>
I20260810 06:32:04.835611 8303 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:04.835700 8303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:04.835949 8303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:32:04 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:04.854209 8303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "dd56dbbc68644545b96b1d65f68be6fc"
format_stamp: "Formatted at 2026-08-10 06:32:04 on dist-test-slave-7lbf"
server_key: "2d9ca105879f03b8e28c1dd687687865"
server_key_iv: "5176f8569d9e586a7c3f1d338ee15d46"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:04.855225 8303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "dd56dbbc68644545b96b1d65f68be6fc"
format_stamp: "Formatted at 2026-08-10 06:32:04 on dist-test-slave-7lbf"
server_key: "2d9ca105879f03b8e28c1dd687687865"
server_key_iv: "5176f8569d9e586a7c3f1d338ee15d46"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:04.867645 8303 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.005s sys 0.002s
I20260810 06:32:04.901862 8324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:04.904021 8303 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.003s sys 0.001s
I20260810 06:32:04.904330 8303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "dd56dbbc68644545b96b1d65f68be6fc"
format_stamp: "Formatted at 2026-08-10 06:32:04 on dist-test-slave-7lbf"
server_key: "2d9ca105879f03b8e28c1dd687687865"
server_key_iv: "5176f8569d9e586a7c3f1d338ee15d46"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:04.904680 8303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:04.933468 8303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:04.937052 8303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:04.937270 8303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:04.938068 8303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:04.939078 8303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:04.939134 8303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:04.939193 8303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:04.939222 8303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:04.952965 8303 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:40119
I20260810 06:32:04.954586 8303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:32:04.956573 8502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:40119 every 8 connection(s)
I20260810 06:32:04.964716 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 8303
I20260810 06:32:04.964859 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:32:04.965163 22287 external_mini_cluster.cc:1428] Setting key 07b68b2fadb52992c8a637fcad42524f
Aug 10 06:32:04 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:04.978243 8510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:04.959357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46719 (local address 127.21.195.194:54051)
0810 06:32:04.961294 (+ 1937us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:04.961367 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:04.962754 (+ 1387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:04.963747 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:04.963758 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:04.964335 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:04.965139 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:04.965163 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:04.967324 (+ 2161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:04.967328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:04.968759 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:04.968774 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:04.969363 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:04.969368 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:04.969642 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:04.970404 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:04.970428 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:04.972092 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:04.974230 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:04.974238 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:04.974261 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:04.974722 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:04.975101 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:04.975105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:04.975107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:04.975348 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:04.975872 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:04.975880 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:04.976271 (+ 391us) client_negotiation.cc:769] Sending connection context
0810 06:32:04.976542 (+ 271us) client_negotiation.cc:240] Negotiation successful
0810 06:32:04.976977 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1670,"thread_start_us":181,"threads_started":1}
I20260810 06:32:04.978436 8297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:04.960785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:54051 (local address 127.21.195.254:46719)
0810 06:32:04.960924 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:04.960928 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:04.961537 (+ 609us) server_negotiation.cc:407] Connection header received
0810 06:32:04.963066 (+ 1529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:04.963070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:04.963154 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:04.963212 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:04.965350 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:04.966275 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:04.968933 (+ 2658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:04.969184 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:04.969284 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:04.972305 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:04.972310 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:04.972312 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:04.972346 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:04.974060 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:04.974859 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:04.974863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:04.974865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:04.974985 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:04.975469 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:04.975472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:04.975474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:04.975745 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:04.975861 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:04.976673 (+ 812us) server_negotiation.cc:299] Negotiation successful
0810 06:32:04.976913 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:32:04.979933 8508 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46719
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:32:04.980237 8508 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:04.980919 8508 heartbeater.cc:511] Master 127.21.195.254:46719 requested a full tablet report, sending...
I20260810 06:32:04.982419 7966 ts_manager.cc:194] Registered new tserver with Master: dd56dbbc68644545b96b1d65f68be6fc (127.21.195.194:40119)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:32:04.983232 7966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:54051
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:32:05.004602 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:36173/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46719
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:38139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:32:05 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
W20260810 06:32:05.194730 8513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:05.195257 8513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:05.195397 8513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:05.202015 8513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:05.202265 8513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:05.202411 8513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:32:05.211380 8513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:38139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.21.195.212:36173/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:05.213336 8513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:05.215047 8513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:05.232223 8523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:05.232385 8520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:05.232234 8519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:05.233721 8513 server_base.cc:1034] running on GCE node
I20260810 06:32:05.234328 8513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:05.235311 8513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:05.238633 8513 hybrid_clock.cc:648] HybridClock initialized: now 1786343525238529 us; error 107 us; skew 500 ppm
Aug 10 06:32:05 dist-test-slave-7lbf krb5kdc[7192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:05.243068 8513 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:32:05.244526 8513 webserver.cc:460] Webserver started at http://127.21.195.195:34673/ using document root <none> and password file <none>
I20260810 06:32:05.245397 8513 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:05.245577 8513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:05.245903 8513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:32:05 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:05.270311 8513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "950c1c22d4eb4d9f91104db13ca9a66f"
format_stamp: "Formatted at 2026-08-10 06:32:05 on dist-test-slave-7lbf"
server_key: "3b8e4a19332134beb220e71e514b1ebe"
server_key_iv: "04d50304d7e43391140548d462e451d6"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:05.271427 8513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "950c1c22d4eb4d9f91104db13ca9a66f"
format_stamp: "Formatted at 2026-08-10 06:32:05 on dist-test-slave-7lbf"
server_key: "3b8e4a19332134beb220e71e514b1ebe"
server_key_iv: "04d50304d7e43391140548d462e451d6"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:05.277783 8513 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260810 06:32:05.297048 8532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:05.299458 8513 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260810 06:32:05.299744 8513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "950c1c22d4eb4d9f91104db13ca9a66f"
format_stamp: "Formatted at 2026-08-10 06:32:05 on dist-test-slave-7lbf"
server_key: "3b8e4a19332134beb220e71e514b1ebe"
server_key_iv: "04d50304d7e43391140548d462e451d6"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:05.300042 8513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:05.321424 8513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:05.324949 8513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:05.325173 8513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:05.325973 8513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:05.327011 8513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:05.327067 8513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:05.327128 8513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:05.327157 8513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:05.338470 8513 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:35761
I20260810 06:32:05.340049 8513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:32:05.340114 8714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:35761 every 8 connection(s)
I20260810 06:32:05.350167 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 8513
I20260810 06:32:05.350330 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:32:05.350682 22287 external_mini_cluster.cc:1428] Setting key 11a46033190b1e94980acd347b613494
Aug 10 06:32:05 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:05.356417 8297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.342349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:49045 (local address 127.21.195.254:46719)
0810 06:32:05.342513 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:05.342519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:05.343583 (+ 1064us) server_negotiation.cc:407] Connection header received
0810 06:32:05.344679 (+ 1096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:05.344682 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:05.344743 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:05.344823 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:05.346198 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.346911 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.348259 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.348501 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.348602 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.351799 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:05.351803 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:05.351806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:05.351842 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:05.354054 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:05.354675 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:05.354679 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:05.354680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:05.354773 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:05.355173 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:05.355177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:05.355179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:05.355394 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:05.355486 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:05.356080 (+ 594us) server_negotiation.cc:299] Negotiation successful
0810 06:32:05.356230 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 06:32:05.357465 8717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.342842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46719 (local address 127.21.195.195:49045)
0810 06:32:05.343401 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:05.343465 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:05.344440 (+ 975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:05.345032 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:05.345040 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:05.345363 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:05.346021 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.346039 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.347094 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.347097 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.348102 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.348116 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.348679 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.348684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.348878 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.349594 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:05.349613 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:05.351594 (+ 1981us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:05.354192 (+ 2598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:05.354201 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:05.354225 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:05.354562 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:05.354879 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:05.354883 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:05.354885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:05.355076 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:05.355505 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:05.355514 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:05.355816 (+ 302us) client_negotiation.cc:769] Sending connection context
0810 06:32:05.356017 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 06:32:05.356399 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":131,"threads_started":1}
I20260810 06:32:05.358960 8715 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46719
I20260810 06:32:05.359238 8715 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:05.359802 8715 heartbeater.cc:511] Master 127.21.195.254:46719 requested a full tablet report, sending...
I20260810 06:32:05.361023 7966 ts_manager.cc:194] Registered new tserver with Master: 950c1c22d4eb4d9f91104db13ca9a66f (127.21.195.195:35761)
I20260810 06:32:05.361778 7966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:49045
I20260810 06:32:05.365010 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:32:05.374991 8297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.367187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44076 (local address 127.21.195.254:46719)
0810 06:32:05.367310 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:05.367315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:05.367612 (+ 297us) server_negotiation.cc:407] Connection header received
0810 06:32:05.367726 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:05.367729 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:05.367778 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:05.367852 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:05.368613 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.369155 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.370081 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.370308 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.370402 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.371814 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:05.371818 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:05.371821 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:05.371859 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:05.373222 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:05.373697 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:05.373700 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:05.373702 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:05.373815 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:05.374102 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:05.374105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:05.374107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:05.374303 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:05.374430 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:05.374675 (+ 245us) server_negotiation.cc:299] Negotiation successful
0810 06:32:05.374802 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:32:05.378288 7966 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:32:05.381719 7966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:32:05.400755 8739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.392107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:40119 (local address 127.0.0.1:59512)
0810 06:32:05.393796 (+ 1689us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:05.393861 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:05.394014 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:05.395271 (+ 1257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:05.395277 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:05.395302 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:05.395466 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.395476 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.397122 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.397126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.398636 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.398650 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.400061 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.400065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.400230 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.400284 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 06:32:05.400417 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 06:32:05.400584 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1477,"thread_start_us":145,"threads_started":1}
I20260810 06:32:05.401635 8745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.393465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59512 (local address 127.21.195.194:40119)
0810 06:32:05.394797 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:05.394813 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:05.394836 (+ 23us) server_negotiation.cc:407] Connection header received
0810 06:32:05.394904 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:05.394909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:05.395105 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:05.395262 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:05.395624 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.397001 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.398825 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.399706 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.399831 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.399991 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:05.401288 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0810 06:32:05.401439 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1233,"thread_start_us":115,"threads_started":1}
I20260810 06:32:05.403476 8735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.392252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:35761 (local address 127.0.0.1:39588)
0810 06:32:05.395521 (+ 3269us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:05.395535 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:05.395621 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:05.396413 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:05.396417 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:05.396435 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:05.396527 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.396532 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.398791 (+ 2259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.398794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.399907 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.399917 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.403092 (+ 3175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.403095 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.403171 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.403190 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 06:32:05.403256 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 06:32:05.403332 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3204,"thread_start_us":108,"threads_started":1}
I20260810 06:32:05.403584 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.393109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39588 (local address 127.21.195.195:35761)
0810 06:32:05.394560 (+ 1451us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:05.394573 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:05.395724 (+ 1151us) server_negotiation.cc:407] Connection header received
0810 06:32:05.395814 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:05.395820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:05.396073 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:05.396253 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:05.396644 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.398667 (+ 2023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.400080 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.402728 (+ 2648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.402861 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.403031 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:05.403325 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 06:32:05.403444 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1332,"thread_start_us":125,"threads_started":1}
I20260810 06:32:05.405743 8401 tablet_service.cc:1467] Processing CreateTablet for tablet 498dfcbfb5f841db886e4ea34b04c5ec (DEFAULT_TABLE table=test-table [id=2d1445eed0ec4d0989833eceb15861df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:32:05.406641 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.393038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41301 (local address 127.0.0.1:53012)
0810 06:32:05.401121 (+ 8083us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:05.401137 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:05.401347 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:05.402285 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:05.402288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:05.402307 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:05.402416 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.402422 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.403789 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.403793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.404919 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.404932 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.406229 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.406233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.406328 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.406355 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 06:32:05.406428 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 06:32:05.406500 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8002,"thread_start_us":109,"threads_started":1}
I20260810 06:32:05.407218 8744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.393218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53012 (local address 127.21.195.193:41301)
0810 06:32:05.394320 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:05.394328 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:05.401258 (+ 6930us) server_negotiation.cc:407] Connection header received
0810 06:32:05.401553 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:05.401561 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:05.401859 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:05.402080 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:05.402553 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.403654 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.405070 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.405914 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.406033 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.406164 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:05.406952 (+ 788us) server_negotiation.cc:299] Negotiation successful
0810 06:32:05.407073 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":985,"thread_start_us":79,"threads_started":1}
I20260810 06:32:05.407308 8401 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 498dfcbfb5f841db886e4ea34b04c5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:32:05.407114 8616 tablet_service.cc:1467] Processing CreateTablet for tablet 498dfcbfb5f841db886e4ea34b04c5ec (DEFAULT_TABLE table=test-table [id=2d1445eed0ec4d0989833eceb15861df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:32:05.408715 8616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 498dfcbfb5f841db886e4ea34b04c5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:32:05.410843 8193 tablet_service.cc:1467] Processing CreateTablet for tablet 498dfcbfb5f841db886e4ea34b04c5ec (DEFAULT_TABLE table=test-table [id=2d1445eed0ec4d0989833eceb15861df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:32:05.412066 8193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 498dfcbfb5f841db886e4ea34b04c5ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:32:05.421065 8751 tablet_bootstrap.cc:492] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4: Bootstrap starting.
I20260810 06:32:05.424561 8751 tablet_bootstrap.cc:654] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4: Neither blocks nor log segments found. Creating new log.
I20260810 06:32:05.425734 8751 log.cc:824] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:05.426100 8747 tablet_bootstrap.cc:492] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc: Bootstrap starting.
I20260810 06:32:05.426366 8750 tablet_bootstrap.cc:492] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: Bootstrap starting.
I20260810 06:32:05.429250 8747 tablet_bootstrap.cc:654] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc: Neither blocks nor log segments found. Creating new log.
I20260810 06:32:05.429797 8750 tablet_bootstrap.cc:654] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: Neither blocks nor log segments found. Creating new log.
I20260810 06:32:05.430938 8750 log.cc:824] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:05.430938 8747 log.cc:824] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:05.434039 8747 tablet_bootstrap.cc:492] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc: No bootstrap required, opened a new log
I20260810 06:32:05.434039 8750 tablet_bootstrap.cc:492] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: No bootstrap required, opened a new log
I20260810 06:32:05.434307 8750 ts_tablet_manager.cc:1397] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 06:32:05.434307 8747 ts_tablet_manager.cc:1397] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260810 06:32:05.438741 8747 raft_consensus.cc:348] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.438741 8750 raft_consensus.cc:348] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.439095 8747 raft_consensus.cc:374] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:32:05.439095 8750 raft_consensus.cc:374] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:32:05.439164 8750 raft_consensus.cc:729] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 950c1c22d4eb4d9f91104db13ca9a66f, State: Initialized, Role: FOLLOWER
I20260810 06:32:05.439164 8747 raft_consensus.cc:729] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd56dbbc68644545b96b1d65f68be6fc, State: Initialized, Role: FOLLOWER
I20260810 06:32:05.440069 8750 consensus_queue.cc:260] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.441148 8751 tablet_bootstrap.cc:492] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4: No bootstrap required, opened a new log
I20260810 06:32:05.441495 8750 ts_tablet_manager.cc:1428] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 06:32:05.441495 8751 ts_tablet_manager.cc:1397] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.004s
I20260810 06:32:05.442022 8715 heartbeater.cc:503] Master 127.21.195.254:46719 was elected leader, sending a full tablet report...
I20260810 06:32:05.444737 8747 consensus_queue.cc:260] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.446324 8747 ts_tablet_manager.cc:1428] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260810 06:32:05.446465 8751 raft_consensus.cc:348] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.446798 8508 heartbeater.cc:503] Master 127.21.195.254:46719 was elected leader, sending a full tablet report...
I20260810 06:32:05.446895 8751 raft_consensus.cc:374] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:32:05.447014 8751 raft_consensus.cc:729] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e43abe02c29649e38adcd320219e27c4, State: Initialized, Role: FOLLOWER
I20260810 06:32:05.447633 8751 consensus_queue.cc:260] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.449383 8294 heartbeater.cc:503] Master 127.21.195.254:46719 was elected leader, sending a full tablet report...
I20260810 06:32:05.451783 8751 ts_tablet_manager.cc:1428] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4: Time spent starting tablet: real 0.010s user 0.000s sys 0.007s
W20260810 06:32:05.465163 8509 tablet.cc:2369] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:32:05.504637 8758 raft_consensus.cc:482] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:32:05.504913 8758 raft_consensus.cc:504] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.506554 8758 leader_election.cc:288] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 950c1c22d4eb4d9f91104db13ca9a66f (127.21.195.195:35761), e43abe02c29649e38adcd320219e27c4 (127.21.195.193:41301)
I20260810 06:32:05.514003 8744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.507830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:49605 (local address 127.21.195.193:41301)
0810 06:32:05.507998 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:05.508025 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:05.508702 (+ 677us) server_negotiation.cc:407] Connection header received
0810 06:32:05.508959 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:05.508964 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:05.509018 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:05.509067 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:05.509721 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.510765 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.512522 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.513199 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.513303 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.513361 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:05.513751 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 06:32:05.513842 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260810 06:32:05.514796 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.507090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41301 (local address 127.21.195.194:49605)
0810 06:32:05.508605 (+ 1515us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:05.508620 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:05.508801 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:05.509414 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:05.509417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:05.509440 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:05.509587 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.509595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.510972 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.510975 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.512367 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.512379 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.513468 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.513472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.513606 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.513632 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 06:32:05.514482 (+ 850us) client_negotiation.cc:240] Negotiation successful
0810 06:32:05.514581 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1436,"thread_start_us":131,"threads_started":1}
I20260810 06:32:05.515955 8228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "498dfcbfb5f841db886e4ea34b04c5ec" candidate_uuid: "dd56dbbc68644545b96b1d65f68be6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43abe02c29649e38adcd320219e27c4" is_pre_election: true
I20260810 06:32:05.516387 8228 raft_consensus.cc:2454] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd56dbbc68644545b96b1d65f68be6fc in term 0.
I20260810 06:32:05.517117 8326 leader_election.cc:302] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd56dbbc68644545b96b1d65f68be6fc, e43abe02c29649e38adcd320219e27c4; no voters:
I20260810 06:32:05.517495 8758 raft_consensus.cc:2781] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:32:05.517647 8758 raft_consensus.cc:482] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:32:05.517692 8758 raft_consensus.cc:3037] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 0 FOLLOWER]: Advancing to term 1
Aug 10 06:32:05 dist-test-slave-7lbf krb5kdc[7192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:05.519220 8758 raft_consensus.cc:504] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.519676 8758 leader_election.cc:288] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [CANDIDATE]: Term 1 election: Requested vote from peers 950c1c22d4eb4d9f91104db13ca9a66f (127.21.195.195:35761), e43abe02c29649e38adcd320219e27c4 (127.21.195.193:41301)
I20260810 06:32:05.520251 8228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "498dfcbfb5f841db886e4ea34b04c5ec" candidate_uuid: "dd56dbbc68644545b96b1d65f68be6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e43abe02c29649e38adcd320219e27c4"
I20260810 06:32:05.520398 8228 raft_consensus.cc:3037] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:32:05.521761 8743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.508578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:42649 (local address 127.21.195.195:35761)
0810 06:32:05.508700 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:05.508704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:05.515549 (+ 6845us) server_negotiation.cc:407] Connection header received
0810 06:32:05.515770 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:05.515774 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:05.515829 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:05.515876 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:05.516285 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.516987 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.520240 (+ 3253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.520931 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.521046 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.521112 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:05.521484 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 06:32:05.521616 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:32:05.521914 8228 raft_consensus.cc:2454] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd56dbbc68644545b96b1d65f68be6fc in term 1.
I20260810 06:32:05.522162 8764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.507862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:35761 (local address 127.21.195.194:42649)
0810 06:32:05.515461 (+ 7599us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:05.515477 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:05.515635 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:05.516046 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:05.516049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:05.516068 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:05.516149 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.516154 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.517170 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.517173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.520049 (+ 2876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:05.520064 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.521224 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.521228 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:05.521321 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.521347 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 06:32:05.521933 (+ 586us) client_negotiation.cc:240] Negotiation successful
0810 06:32:05.522026 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7534,"thread_start_us":134,"threads_started":1}
I20260810 06:32:05.522846 8326 leader_election.cc:302] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd56dbbc68644545b96b1d65f68be6fc, e43abe02c29649e38adcd320219e27c4; no voters:
I20260810 06:32:05.523129 8758 raft_consensus.cc:2781] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:32:05.523360 8758 raft_consensus.cc:686] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 1 LEADER]: Becoming Leader. State: Replica: dd56dbbc68644545b96b1d65f68be6fc, State: Running, Role: LEADER
I20260810 06:32:05.523337 8646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "498dfcbfb5f841db886e4ea34b04c5ec" candidate_uuid: "dd56dbbc68644545b96b1d65f68be6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" is_pre_election: true
I20260810 06:32:05.523689 8646 raft_consensus.cc:2454] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd56dbbc68644545b96b1d65f68be6fc in term 0.
I20260810 06:32:05.523744 8758 consensus_queue.cc:237] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } }
I20260810 06:32:05.524112 8645 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "498dfcbfb5f841db886e4ea34b04c5ec" candidate_uuid: "dd56dbbc68644545b96b1d65f68be6fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "950c1c22d4eb4d9f91104db13ca9a66f"
I20260810 06:32:05.524258 8645 raft_consensus.cc:3037] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:32:05.526131 8645 raft_consensus.cc:2454] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd56dbbc68644545b96b1d65f68be6fc in term 1.
I20260810 06:32:05.528034 7966 catalog_manager.cc:5495] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc reported cstate change: term changed from 0 to 1, leader changed from <none> to dd56dbbc68644545b96b1d65f68be6fc (127.21.195.194). New cstate: current_term: 1 leader_uuid: "dd56dbbc68644545b96b1d65f68be6fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd56dbbc68644545b96b1d65f68be6fc" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 } health_report { overall_health: UNKNOWN } } }
I20260810 06:32:05.557608 8745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.552968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59528 (local address 127.21.195.194:40119)
0810 06:32:05.553105 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:05.553109 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:05.553122 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:32:05.553261 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:05.553264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:05.553323 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:05.553431 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:32:05.553766 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.554475 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.555667 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:05.555899 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:05.555997 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:05.556436 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:32:05.557124 (+ 688us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:32:05.557271 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:05.557318 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 06:32:05.557406 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:32:05.566152 8645 raft_consensus.cc:1261] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 1 FOLLOWER]: Refusing update from remote peer dd56dbbc68644545b96b1d65f68be6fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:32:05.566152 8228 raft_consensus.cc:1261] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4 [term 1 FOLLOWER]: Refusing update from remote peer dd56dbbc68644545b96b1d65f68be6fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:32:05.567145 8768 consensus_queue.cc:1035] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "950c1c22d4eb4d9f91104db13ca9a66f" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 35761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:32:05.567396 8758 consensus_queue.cc:1035] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "e43abe02c29649e38adcd320219e27c4" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 06:32:05.580209 8295 tablet.cc:2369] T 498dfcbfb5f841db886e4ea34b04c5ec P e43abe02c29649e38adcd320219e27c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:32:05.586302 8780 mvcc.cc:205] Tried to move back new op lower bound from 7316863080709177344 to 7316863080549208064. Current Snapshot: MvccSnapshot[applied={T|T < 7316863080709177344}]
I20260810 06:32:05.586647 8785 mvcc.cc:205] Tried to move back new op lower bound from 7316863080709177344 to 7316863080549208064. Current Snapshot: MvccSnapshot[applied={T|T < 7316863080709177344}]
I20260810 06:32:05.603099 7966 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:32:05.603340 7966 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:32:05.606426 7966 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a6b11d0efa84b439d802c4085415e64: Sending DeleteTablet for 3 replicas of tablet 498dfcbfb5f841db886e4ea34b04c5ec
I20260810 06:32:05.607633 8401 tablet_service.cc:1514] Processing DeleteTablet for tablet 498dfcbfb5f841db886e4ea34b04c5ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:32:05 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:59512
I20260810 06:32:05.608278 8193 tablet_service.cc:1514] Processing DeleteTablet for tablet 498dfcbfb5f841db886e4ea34b04c5ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:32:05 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:53012
I20260810 06:32:05.609289 8616 tablet_service.cc:1514] Processing DeleteTablet for tablet 498dfcbfb5f841db886e4ea34b04c5ec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:32:05 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:39588
I20260810 06:32:05.610870 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 8087
I20260810 06:32:05.653985 8798 tablet_replica.cc:330] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: stopping tablet replica
I20260810 06:32:05.654469 8798 raft_consensus.cc:2229] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:32:05.654893 8798 raft_consensus.cc:2258] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:32:05.656929 8798 ts_tablet_manager.cc:1905] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:32:05.658900 8795 tablet_replica.cc:330] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc: stopping tablet replica
I20260810 06:32:05.659538 8795 raft_consensus.cc:2229] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:32:05.661710 8798 ts_tablet_manager.cc:1918] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:32:05.661903 8798 log.cc:1196] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/498dfcbfb5f841db886e4ea34b04c5ec
I20260810 06:32:05.662331 8798 ts_tablet_manager.cc:1939] T 498dfcbfb5f841db886e4ea34b04c5ec P 950c1c22d4eb4d9f91104db13ca9a66f: Deleting consensus metadata
I20260810 06:32:05.663017 8795 raft_consensus.cc:2258] T 498dfcbfb5f841db886e4ea34b04c5ec P dd56dbbc68644545b96b1d65f68be6fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:32:05.664007 7951 catalog_manager.cc:4841] TS 950c1c22d4eb4d9f91104db13ca9a66f (127.21.195.195:35761): tablet 498dfcbfb5f841db886e4ea34b04c5ec (table test-table [id=2d1445eed0ec4d0989833eceb15861df]) successfully deleted
W20260810 06:32:05.665709 7946 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:41301 (error 108)
I20260810 06:32:05.666008 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 8303
I20260810 06:32:05.675706 8736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:05.675359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41301 (local address 127.0.0.1:53022)
0810 06:32:05.675506 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:05.675604 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:41301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 06:32:05.675900 7946 catalog_manager.cc:4584] TS e43abe02c29649e38adcd320219e27c4 (127.21.195.193:41301): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 498dfcbfb5f841db886e4ea34b04c5ec: Network error: Client connection negotiation failed: client connection to 127.21.195.193:41301: connect: Connection refused (error 111)
I20260810 06:32:05.686590 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 8513
I20260810 06:32:05.703037 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 7919
I20260810 06:32:05.726266 22287 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 06:32:06.072863 22287 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 06:32:06.073019 22287 mini_ranger.cc:66] Stopping Ranger...
I20260810 06:32:06.419047 22287 mini_ranger.cc:68] Stopped Ranger
2026-08-10 06:32:06.419 UTC [7238] LOG: received smart shutdown request
2026-08-10 06:32:06.423 UTC [7238] LOG: background worker "logical replication launcher" (PID 7256) exited with exit code 1
2026-08-10 06:32:06.423 UTC [7247] LOG: shutting down
2026-08-10 06:32:06.567 UTC [7238] LOG: database system is shut down
2026-08-10T06:32:06Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49463 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:32:06 dist-test-slave-7lbf krb5kdc[8818](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:32:06 dist-test-slave-7lbf krb5kdc[8818](info): set up 2 sockets
Aug 10 06:32:06 dist-test-slave-7lbf krb5kdc[8818](info): commencing operation
krb5kdc: starting...
W20260810 06:32:07.856042 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:32:07 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343527, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:32:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:32:07Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.21.195.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.21.195.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/rangeradmin_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/rangeradmin_127.21.195.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.21.195.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.21.195.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/rangerlookup_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/rangerlookup_127.21.195.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.195.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.21.195.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/HTTP_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/HTTP_127.21.195.212@KRBTEST.COM.keytab.
I20260810 06:32:08.042039 22287 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskvl7b6p/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/postgres -l logfile start
2026-08-10 06:32:10.425 UTC [8874] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 06:32:10.425 UTC [8874] LOG: listening on IPv4 address "127.21.195.212", port 36477
2026-08-10 06:32:10.429 UTC [8874] LOG: listening on Unix socket "/tmp/.s.PGSQL.36477"
2026-08-10 06:32:10.457 UTC [8878] LOG: database system was shut down at 2026-08-10 06:32:09 UTC
2026-08-10 06:32:10.461 UTC [8874] LOG: database system is ready to accept connections
I20260810 06:32:11.544821 22287 mini_postgres.cc:96] Postgres bound to 36477
2026-08-10 06:32:11.552 UTC [8895] FATAL: database "slave" does not exist
127.21.195.212:36477 - accepting connections
I20260810 06:32:11.553042 22287 mini_ranger.cc:161] Starting Ranger...
I20260810 06:32:11.569561 22287 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 06:32:12.005460 22287 mini_ranger.cc:87] Created ranger Postgres database
I20260810 06:32:12.005581 22287 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-admin
2026-08-10 06:32:12,297 [I] DB FLAVOR :POSTGRES
2026-08-10 06:32:12,298 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 06:32:12,298 [I] Checking connection..
2026-08-10 06:32:12,298 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 06:32:12,556 [I] Checking connection passed.
2026-08-10 06:32:12,556 [I] --------- Verifying version history table ---------
2026-08-10 06:32:12,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:32:12,821 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 06:32:12,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:32:13,100 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 06:32:13,100 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 06:32:13,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 06:32:13.353 UTC [8996] WARNING: there is no transaction in progress
2026-08-10 06:32:13,362 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 06:32:13,363 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 06:32:13,637 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 06:32:13,638 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 06:32:13,638 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 06:32:13,895 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 06:32:14,165 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7lbf.c.gcp-upstream.internal','N') ;"
2026-08-10 06:32:14,435 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 06:32:14,713 [I] Table x_portal_user does not exist in database ranger
2026-08-10 06:32:14,713 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 06:32:14,975 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 06:32:14,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 06:32:15,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 06:32:15,536 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 06:32:15,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 06:32:16.503 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.518 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.534 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.548 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.564 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.579 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.636 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.643 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.658 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.668 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.679 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.693 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.703 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.709 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.715 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:16.721 UTC [9176] WARNING: there is no transaction in progress
2026-08-10 06:32:17,327 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 06:32:17,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 06:32:17,590 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 06:32:17,590 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 06:32:17,841 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 06:32:17,841 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 06:32:18,087 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 06:32:18,088 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 06:32:18,364 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 06:32:18,615 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7lbf.c.gcp-upstream.internal';"
2026-08-10 06:32:18,886 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 06:32:18,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 06:32:19,142 [I] DB_PATCHES have already been applied
I20260810 06:32:19.149108 22287 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-admin:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskvl7b6p/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 06:32:19.149207 22287 mini_ranger.cc:193] Using host: 127.21.195.212
I20260810 06:32:19.154083 22287 mini_ranger.cc:227] Ranger admin URL: http://127.21.195.212:45659
Aug 10, 2026 6:32:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:32:19 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:32:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 6:32:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 6:32:19 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 6:32:20 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 6:32:20 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 06:32:20.460860 22287 mini_ranger.cc:160] Time spent starting Ranger: real 8.908s user 0.006s sys 0.006s
Aug 10, 2026 6:32:41 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 6:32:41 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 6:32:41 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 6:32:41 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 6:32:42 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 06:32:43.573238 22287 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.21.195.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.21.195.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/rangerkms_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.21.195.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/rangerkms_127.21.195.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.195.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.21.195.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.195.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/HTTP_127.21.195.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.195.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/HTTP_127.21.195.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 06:32:43 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343563, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 06:32:43.685184 22287 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 06:32:43.698304 22287 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 06:32:44.476446 22287 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 06:32:44.476547 22287 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms
I20260810 06:32:44.476567 22287 mini_ranger_kms.cc:227] Using postgres at 127.21.195.212:36477
2026-08-10 06:32:44,661 [I] DB FLAVOR :POSTGRES
2026-08-10 06:32:44,661 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 06:32:44,661 [I] Checking connection
2026-08-10 06:32:44,661 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 06:32:44,925 [I] connection success
2026-08-10 06:32:44,925 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 06:32:44,925 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 06:32:44,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 06:32:45,172 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 06:32:45,172 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 06:32:45,173 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 06:32:45,173 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.195.212:36477/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 06:32:45,450 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 06:32:45.970785 22287 mini_ranger_kms.cc:310] Created kms service
I20260810 06:32:46.191603 22287 mini_ranger_kms.cc:326] Created kudu user
I20260810 06:32:46.259409 22287 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 06:32:46 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343563, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:46.751209 22287 mini_ranger_kms.cc:384] Added ranger policy
I20260810 06:32:46.751377 22287 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms:/tmp/dist-test-taskvl7b6p/build/debug/bin/postgresql.jar:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskvl7b6p/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 06:32:46.751399 22287 mini_ranger_kms.cc:240] Using host: 127.21.195.212
I20260810 06:32:46.756963 22287 mini_ranger_kms.cc:276] Ranger KMS PID: 9457
I20260810 06:32:46.757061 22287 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.21.195.212:55989
Aug 10, 2026 6:32:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 6:32:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 6:32:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 6:32:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 6:32:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 6:32:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 06:32:49 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786343569, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.195.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:49.256702 22287 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.572s user 0.022s sys 0.147s
I20260810 06:32:49.256857 22287 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 06:32:49.256950 22287 mini_ranger_kms.cc:401] 127.21.195.212:55989/kms/v1/keys
Aug 10 06:32:49 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343569, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.195.212@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
Aug 10 06:32:50 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343569, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.195.212@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
Aug 10 06:32:52 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:32:52.546414 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46863
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:46863
--ranger_config_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:55989/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:32:52.673733 9540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:52.674063 9540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:52.674108 9540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:52.678490 9540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:32:52.678578 9540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:52.678597 9540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:52.678613 9540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:32:52.678627 9540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:32:52.684999 9540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
--ranger_kms_url=127.21.195.212:55989/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:46863
--ranger_config_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:52.686332 9540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:52.687548 9540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:52.697732 9546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:52.697732 9549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:52.697736 9545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:52.698300 9540 server_base.cc:1034] running on GCE node
I20260810 06:32:52.698973 9540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:52.700289 9540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:52.701476 9540 hybrid_clock.cc:648] HybridClock initialized: now 1786343572701450 us; error 45 us; skew 500 ppm
Aug 10 06:32:52 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343572, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:52.709225 9540 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:32:52.710533 9540 webserver.cc:460] Webserver started at http://127.21.195.254:42265/ using document root <none> and password file <none>
I20260810 06:32:52.711169 9540 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:52.711244 9540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:52.711477 9540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:32:52 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343572, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:52.765179 9540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "4131aa85087942ae8db86c4ab7712bbe"
format_stamp: "Formatted at 2026-08-10 06:32:52 on dist-test-slave-7lbf"
server_key: "c8c23ed02a0dbb0e279ba22c437637f8"
server_key_iv: "2dd4e2106e0231b013f7ca9a12a55ff8"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:52.766121 9540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "4131aa85087942ae8db86c4ab7712bbe"
format_stamp: "Formatted at 2026-08-10 06:32:52 on dist-test-slave-7lbf"
server_key: "c8c23ed02a0dbb0e279ba22c437637f8"
server_key_iv: "2dd4e2106e0231b013f7ca9a12a55ff8"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:52.771986 9540 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260810 06:32:52.792270 9556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:52.794962 9540 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260810 06:32:52.795248 9540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "4131aa85087942ae8db86c4ab7712bbe"
format_stamp: "Formatted at 2026-08-10 06:32:52 on dist-test-slave-7lbf"
server_key: "c8c23ed02a0dbb0e279ba22c437637f8"
server_key_iv: "2dd4e2106e0231b013f7ca9a12a55ff8"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:52.795589 9540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:52.815922 9540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:52.819399 9540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:52.819693 9540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:52.828208 9540 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:46863
I20260810 06:32:52.828238 9631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:46863 every 8 connection(s)
I20260810 06:32:52.829386 9540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:32:52.833388 9633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:32:52.836421 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 9540
I20260810 06:32:52.836571 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:32:52.836880 22287 external_mini_cluster.cc:1428] Setting key e2e814fa002791240db18806695c1dd2
I20260810 06:32:52.842222 9633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Bootstrap starting.
I20260810 06:32:52.845592 9633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Neither blocks nor log segments found. Creating new log.
Aug 10 06:32:52 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343572, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:52.846642 9633 log.cc:824] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:52.849423 9633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: No bootstrap required, opened a new log
I20260810 06:32:52.853677 9633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } }
I20260810 06:32:52.853977 9633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:32:52.854053 9633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4131aa85087942ae8db86c4ab7712bbe, State: Initialized, Role: FOLLOWER
I20260810 06:32:52.854557 9633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } }
I20260810 06:32:52.854707 9633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:32:52.854771 9633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:32:52.854802 9636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:52.838611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34656 (local address 127.21.195.254:46863)
0810 06:32:52.839076 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:52.839093 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:52.839134 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:32:52.839883 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:52.839906 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:52.840293 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:52.840706 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:52.841632 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:52.842748 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:52.843666 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:52.844179 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:52.844352 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:52.847269 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:52.847277 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:52.847297 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:52.847333 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:52.850189 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:52.850839 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:52.850846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:52.850854 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:52.851010 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:52.851389 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:52.851392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:52.851393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:52.852027 (+ 634us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:52.852933 (+ 906us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:52.853129 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 06:32:52.853503 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":126,"threads_started":1}
I20260810 06:32:52.854877 9633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:32:52.855997 9633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } }
I20260810 06:32:52.856386 9633 leader_election.cc:302] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4131aa85087942ae8db86c4ab7712bbe; no voters:
I20260810 06:32:52.856735 9633 leader_election.cc:288] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:32:52.856925 9640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:32:52.857172 9640 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 1 LEADER]: Becoming Leader. State: Replica: 4131aa85087942ae8db86c4ab7712bbe, State: Running, Role: LEADER
I20260810 06:32:52.857621 9640 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } }
I20260810 06:32:52.858412 9633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:32:52.859082 9640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4131aa85087942ae8db86c4ab7712bbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } } }
I20260810 06:32:52.859217 9640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: This master's current role is: LEADER
I20260810 06:32:52.859437 9640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4131aa85087942ae8db86c4ab7712bbe. Latest consensus state: current_term: 1 leader_uuid: "4131aa85087942ae8db86c4ab7712bbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } } }
I20260810 06:32:52.859529 9640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: This master's current role is: LEADER
I20260810 06:32:52.859818 9648 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:32:52.864099 9648 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:32:52.864696 9633 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 06:32:52.879909 9648 catalog_manager.cc:1347] Generated new cluster ID: ec9de3a117de4fffa194bbf969dd3fa5
I20260810 06:32:52.880036 9648 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:32:52.894475 9648 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:32:52.895934 9648 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:32:52.903270 9648 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Generated new TSK 0
I20260810 06:32:52.904349 9648 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:32:53.674814 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:55989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46863
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:32:53.806548 9699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:53.806875 9699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:53.806949 9699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:53.811525 9699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:53.811702 9699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:53.811839 9699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:32:53.818452 9699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.21.195.212:55989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:53.820271 9699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:53.821904 9699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:53.835144 9712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:53.835172 9715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:53.835402 9717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:53.835611 9699 server_base.cc:1034] running on GCE node
I20260810 06:32:53.836158 9699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:53.836876 9699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:53.838071 9699 hybrid_clock.cc:648] HybridClock initialized: now 1786343573838025 us; error 45 us; skew 500 ppm
Aug 10 06:32:53 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343573, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:53.842089 9699 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:32:53.843379 9699 webserver.cc:460] Webserver started at http://127.21.195.193:35215/ using document root <none> and password file <none>
I20260810 06:32:53.844211 9699 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:53.844345 9699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:53.844616 9699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:32:53 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343573, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:53.863900 9699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "375612155bd14d4ea1e25fe5fba42b77"
format_stamp: "Formatted at 2026-08-10 06:32:53 on dist-test-slave-7lbf"
server_key: "8926b3a96703102f22b3caa4fedabf4f"
server_key_iv: "b1d34ca2d97de5ae491fcdca5a71b871"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:53.865175 9699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "375612155bd14d4ea1e25fe5fba42b77"
format_stamp: "Formatted at 2026-08-10 06:32:53 on dist-test-slave-7lbf"
server_key: "8926b3a96703102f22b3caa4fedabf4f"
server_key_iv: "b1d34ca2d97de5ae491fcdca5a71b871"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:53.871361 9699 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260810 06:32:53.891198 9726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:53.893217 9699 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260810 06:32:53.893379 9699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "375612155bd14d4ea1e25fe5fba42b77"
format_stamp: "Formatted at 2026-08-10 06:32:53 on dist-test-slave-7lbf"
server_key: "8926b3a96703102f22b3caa4fedabf4f"
server_key_iv: "b1d34ca2d97de5ae491fcdca5a71b871"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:53.893563 9699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:53.917977 9699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:53.922137 9699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:53.922435 9699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:53.923604 9699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:53.924925 9699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:53.925064 9699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 06:32:53.925204 9699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:53.925295 9699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:53.937197 9699 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:39745
I20260810 06:32:53.938345 9699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:32:53.946161 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 9699
I20260810 06:32:53.946322 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:32:53.946655 22287 external_mini_cluster.cc:1428] Setting key a30c99834d293a050899e08ed4f09565
I20260810 06:32:53.941059 9905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:39745 every 8 connection(s)
Aug 10 06:32:53 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343573, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:32:53.969173 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:53.945224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:47739 (local address 127.21.195.254:46863)
0810 06:32:53.946531 (+ 1307us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:53.946536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:53.946556 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:32:53.951475 (+ 4919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:53.951480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:53.951553 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:53.951648 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:53.953607 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:53.954576 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:53.956465 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:53.956856 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:53.956995 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:53.963709 (+ 6714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:53.963715 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:53.963717 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:53.963756 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:53.965833 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:53.966674 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:53.966679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:53.966681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:53.966799 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:53.967391 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:53.967395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:53.967396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:53.967668 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:53.967782 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:53.968719 (+ 937us) server_negotiation.cc:299] Negotiation successful
0810 06:32:53.968953 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1220,"thread_start_us":81,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:32:53.970399 9910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:53.943879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46863 (local address 127.21.195.193:47739)
0810 06:32:53.945718 (+ 1839us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:53.945793 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:53.950987 (+ 5194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:53.952087 (+ 1100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:53.952100 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:53.952544 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:53.953367 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:53.953393 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:53.954769 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:53.954772 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:53.956296 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:53.956311 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:53.960228 (+ 3917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:53.960234 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:53.960535 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:53.961417 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:53.961446 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:53.963398 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:53.966049 (+ 2651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:53.966057 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:53.966083 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:53.966521 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:53.966998 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:53.967001 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:53.967003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:53.967234 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:53.967813 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:53.967822 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:53.968316 (+ 494us) client_negotiation.cc:769] Sending connection context
0810 06:32:53.968610 (+ 294us) client_negotiation.cc:240] Negotiation successful
0810 06:32:53.969109 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1519,"thread_start_us":168,"threads_started":1}
I20260810 06:32:53.972451 9907 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46863
I20260810 06:32:53.972787 9907 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:53.973508 9907 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:53.975759 9580 ts_manager.cc:194] Registered new tserver with Master: 375612155bd14d4ea1e25fe5fba42b77 (127.21.195.193:39745)
I20260810 06:32:53.977479 9580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:47739
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:32:53.993144 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:55989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46863
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:32:54 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786343574, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 06:32:54.140441 9918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:54.140751 9918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:54.140816 9918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:54.145162 9918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:54.145254 9918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:54.145342 9918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:32:54.151386 9918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.21.195.212:55989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:54.152671 9918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:54.153951 9918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:54.164731 9932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:54.164882 9928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:54.165298 9930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:54.165679 9918 server_base.cc:1034] running on GCE node
I20260810 06:32:54.166211 9918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:54.166960 9918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:54.168152 9918 hybrid_clock.cc:648] HybridClock initialized: now 1786343574168120 us; error 49 us; skew 500 ppm
Aug 10 06:32:54 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343574, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:54.171603 9918 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:32:54.173049 9918 webserver.cc:460] Webserver started at http://127.21.195.194:41627/ using document root <none> and password file <none>
I20260810 06:32:54.173990 9918 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:54.174105 9918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:54.174489 9918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:32:54 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343574, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:54.192816 9918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "c7eecd5aac1147489760ddbb4cbae657"
format_stamp: "Formatted at 2026-08-10 06:32:54 on dist-test-slave-7lbf"
server_key: "587ceecb09067ae30e79413b9a06471b"
server_key_iv: "e9fec4055c0928c63cbbdb3503f2d3c5"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:54.193998 9918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "c7eecd5aac1147489760ddbb4cbae657"
format_stamp: "Formatted at 2026-08-10 06:32:54 on dist-test-slave-7lbf"
server_key: "587ceecb09067ae30e79413b9a06471b"
server_key_iv: "e9fec4055c0928c63cbbdb3503f2d3c5"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:54.204268 9918 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.003s sys 0.001s
I20260810 06:32:54.233605 9944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:54.235954 9918 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.002s sys 0.000s
I20260810 06:32:54.236161 9918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "c7eecd5aac1147489760ddbb4cbae657"
format_stamp: "Formatted at 2026-08-10 06:32:54 on dist-test-slave-7lbf"
server_key: "587ceecb09067ae30e79413b9a06471b"
server_key_iv: "e9fec4055c0928c63cbbdb3503f2d3c5"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:54.236353 9918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:54.291774 9918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:54.295747 9918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:54.295965 9918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:54.296656 9918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:54.297681 9918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:54.297744 9918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:54.297806 9918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:54.297832 9918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:54.308135 9918 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:43835
I20260810 06:32:54.308194 10126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:43835 every 8 connection(s)
I20260810 06:32:54.309254 9918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:32:54.311829 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 9918
I20260810 06:32:54.311991 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:32:54.312309 22287 external_mini_cluster.cc:1428] Setting key 7256c4e1232c50c924536b11b02c6d31
Aug 10 06:32:54 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343574, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:54.324895 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:54.311565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:49611 (local address 127.21.195.254:46863)
0810 06:32:54.312831 (+ 1266us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:54.312836 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:54.312856 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:32:54.313897 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:54.313901 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:54.313952 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:54.314049 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:54.315582 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:54.316351 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:54.318044 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:54.318411 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:54.318539 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:54.320989 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:54.320993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:54.320995 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:54.321025 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:54.322536 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:54.323106 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:54.323109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:54.323111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:54.323200 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:54.323569 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:54.323573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:54.323575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:54.323816 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:54.323916 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:54.324533 (+ 617us) server_negotiation.cc:299] Negotiation successful
0810 06:32:54.324691 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1153}
I20260810 06:32:54.326017 10138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:54.312019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46863 (local address 127.21.195.194:49611)
0810 06:32:54.312625 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:54.312687 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:54.313655 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:54.314257 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:54.314269 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:54.314659 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:54.315400 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:54.315420 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:54.316513 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:54.316517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:54.317907 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:54.317920 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:54.318567 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:54.318569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:54.318730 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:54.319333 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:54.319351 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:54.320790 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:54.322665 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:54.322673 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:54.322694 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:54.322999 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:54.323289 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:54.323293 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:54.323294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:54.323473 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:54.323950 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:54.323959 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:54.324270 (+ 311us) client_negotiation.cc:769] Sending connection context
0810 06:32:54.324471 (+ 201us) client_negotiation.cc:240] Negotiation successful
0810 06:32:54.324852 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:32:54.335654 10132 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46863
I20260810 06:32:54.336050 10132 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:54.336884 10132 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:54.338562 9580 ts_manager.cc:194] Registered new tserver with Master: c7eecd5aac1147489760ddbb4cbae657 (127.21.195.194:43835)
I20260810 06:32:54.339392 9580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:49611
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:32:54.365151 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:55989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46863
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:32:54 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343574, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
W20260810 06:32:54.542999 10143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:54.543599 10143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:54.543711 10143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:54.550011 10143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:54.550113 10143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:54.550203 10143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:32:54.558553 10143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.21.195.212:55989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:54.560268 10143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:54.561825 10143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:54.575666 10152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:54.575922 10151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:54.576584 10143 server_base.cc:1034] running on GCE node
W20260810 06:32:54.576951 10154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:54.577580 10143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:54.578477 10143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:54.579665 10143 hybrid_clock.cc:648] HybridClock initialized: now 1786343574579636 us; error 45 us; skew 500 ppm
Aug 10 06:32:54 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343574, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:54.583567 10143 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:32:54.585005 10143 webserver.cc:460] Webserver started at http://127.21.195.195:37209/ using document root <none> and password file <none>
I20260810 06:32:54.585842 10143 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:54.585937 10143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:54.586272 10143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 06:32:54 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343574, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:54.612201 10143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "8dc4c6e243e34d3299064e5dc1d7f977"
format_stamp: "Formatted at 2026-08-10 06:32:54 on dist-test-slave-7lbf"
server_key: "4244ab8948a6280a300bdc2e3f18d691"
server_key_iv: "cdf71f545375df7a30c995610bc804f3"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:54.615901 10143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "8dc4c6e243e34d3299064e5dc1d7f977"
format_stamp: "Formatted at 2026-08-10 06:32:54 on dist-test-slave-7lbf"
server_key: "4244ab8948a6280a300bdc2e3f18d691"
server_key_iv: "cdf71f545375df7a30c995610bc804f3"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:54.625857 10143 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.003s
I20260810 06:32:54.662154 10165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:54.665259 10143 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260810 06:32:54.665445 10143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "8dc4c6e243e34d3299064e5dc1d7f977"
format_stamp: "Formatted at 2026-08-10 06:32:54 on dist-test-slave-7lbf"
server_key: "4244ab8948a6280a300bdc2e3f18d691"
server_key_iv: "cdf71f545375df7a30c995610bc804f3"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:54.665637 10143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:54.707646 10143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:54.711927 10143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:54.712225 10143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:54.713119 10143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:54.714394 10143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:54.714530 10143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 06:32:54.714628 10143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:54.714681 10143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:54.727339 10143 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:36091
I20260810 06:32:54.727380 10349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:36091 every 8 connection(s)
I20260810 06:32:54.728909 10143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:32:54.737967 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 10143
I20260810 06:32:54.738128 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:32:54.738476 22287 external_mini_cluster.cc:1428] Setting key 686e81a3628c02201a21f6041532fcbb
Aug 10 06:32:54 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343574, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:54.747499 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:54.731345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:58717 (local address 127.21.195.254:46863)
0810 06:32:54.731500 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:54.731505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:54.732788 (+ 1283us) server_negotiation.cc:407] Connection header received
0810 06:32:54.734223 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:54.734227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:54.734296 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:54.734402 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:54.736153 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:54.736981 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:54.738916 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:54.739270 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:54.739361 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:54.742864 (+ 3503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:54.742869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:54.742872 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:54.742906 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:54.744607 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:54.745371 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:54.745375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:54.745377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:54.745483 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:54.746020 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:54.746024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:54.746026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:54.746279 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:54.746375 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:54.747146 (+ 771us) server_negotiation.cc:299] Negotiation successful
0810 06:32:54.747289 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 06:32:54.749469 10352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:54.731959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46863 (local address 127.21.195.195:58717)
0810 06:32:54.732590 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:54.732655 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:54.733919 (+ 1264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:54.734668 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:54.734680 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:54.735111 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:54.735942 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:54.735967 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:54.737153 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:54.737157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:54.738748 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:54.738761 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:54.739609 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:54.739613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:54.739847 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:54.740608 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:54.740632 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:54.742601 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:54.744749 (+ 2148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:54.744757 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:54.744788 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:54.745248 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:54.745607 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:54.745610 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:54.745613 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:54.745862 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:54.746448 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:54.746457 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:54.746836 (+ 379us) client_negotiation.cc:769] Sending connection context
0810 06:32:54.747869 (+ 1033us) client_negotiation.cc:240] Negotiation successful
0810 06:32:54.748270 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":168,"threads_started":1}
I20260810 06:32:54.751226 10350 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46863
I20260810 06:32:54.751529 10350 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:54.752187 10350 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:54.753383 9580 ts_manager.cc:194] Registered new tserver with Master: 8dc4c6e243e34d3299064e5dc1d7f977 (127.21.195.195:36091)
I20260810 06:32:54.754201 9580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:58717
I20260810 06:32:54.765425 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:32:54.766268 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 9699
I20260810 06:32:54.817451 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 9918
I20260810 06:32:54.851712 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 10143
I20260810 06:32:54.870878 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 9540
I20260810 06:32:54.890055 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46863
--webserver_interface=127.21.195.254
--webserver_port=42265
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:46863
--ranger_config_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:55989/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.195.212:55989/kms with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:32:55.012300 10355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:55.012615 10355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:55.012660 10355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:55.016979 10355 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:32:55.017072 10355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:55.017094 10355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:55.017112 10355 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:32:55.017127 10355 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:32:55.023182 10355 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.195.212:55989/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:46863
--ranger_config_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:46863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=42265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:55.024466 10355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:55.025648 10355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:55.035344 10368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:55.035414 10355 server_base.cc:1034] running on GCE node
W20260810 06:32:55.035352 10366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:55.035352 10364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:55.036188 10355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:55.037424 10355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:55.038599 10355 hybrid_clock.cc:648] HybridClock initialized: now 1786343575038578 us; error 36 us; skew 500 ppm
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:55.041699 10355 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:32:55.042810 10355 webserver.cc:460] Webserver started at http://127.21.195.254:42265/ using document root <none> and password file <none>
I20260810 06:32:55.043390 10355 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:55.043466 10355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:55.087704 10355 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260810 06:32:55.090596 10379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.092203 10355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 06:32:55.092360 10355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "4131aa85087942ae8db86c4ab7712bbe"
format_stamp: "Formatted at 2026-08-10 06:32:52 on dist-test-slave-7lbf"
server_key: "c8c23ed02a0dbb0e279ba22c437637f8"
server_key_iv: "2dd4e2106e0231b013f7ca9a12a55ff8"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:55.093014 10355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:55.107623 10355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:55.110790 10355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:55.111021 10355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:55.118993 10462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:46863 every 8 connection(s)
I20260810 06:32:55.118999 10355 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:46863
I20260810 06:32:55.120307 10355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:32:55.125334 10463 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:32:55.127473 10463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Bootstrap starting.
I20260810 06:32:55.129170 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 10355
I20260810 06:32:55.129731 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:55989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:39745
--local_ip_for_outbound_sockets=127.21.195.193
--tserver_master_addrs=127.21.195.254:46863
--webserver_port=35215
--webserver_interface=127.21.195.193
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.195.212:55989/kms with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:32:55.145704 10463 log.cc:824] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:55.153628 10463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:32:55.154083 10463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Bootstrap complete.
I20260810 06:32:55.158401 10463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } }
I20260810 06:32:55.158871 10463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4131aa85087942ae8db86c4ab7712bbe, State: Initialized, Role: FOLLOWER
I20260810 06:32:55.159403 10463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } }
I20260810 06:32:55.159534 10463 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:32:55.159605 10463 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:32:55.159704 10463 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:32:55.161968 10463 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } }
I20260810 06:32:55.162340 10463 leader_election.cc:302] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4131aa85087942ae8db86c4ab7712bbe; no voters:
I20260810 06:32:55.162678 10463 leader_election.cc:288] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 06:32:55.162853 10471 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:32:55.163242 10471 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [term 2 LEADER]: Becoming Leader. State: Replica: 4131aa85087942ae8db86c4ab7712bbe, State: Running, Role: LEADER
I20260810 06:32:55.163674 10471 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } }
I20260810 06:32:55.164034 10463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:32:55.165230 10474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4131aa85087942ae8db86c4ab7712bbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } } }
I20260810 06:32:55.165376 10474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: This master's current role is: LEADER
I20260810 06:32:55.166275 10484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:32:55.166276 10475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4131aa85087942ae8db86c4ab7712bbe. Latest consensus state: current_term: 2 leader_uuid: "4131aa85087942ae8db86c4ab7712bbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4131aa85087942ae8db86c4ab7712bbe" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 46863 } } }
I20260810 06:32:55.166972 10475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe [sys.catalog]: This master's current role is: LEADER
I20260810 06:32:55.166847 10463 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 06:32:55.173234 10484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:32:55.174471 10484 catalog_manager.cc:1259] Loaded cluster ID: ec9de3a117de4fffa194bbf969dd3fa5
I20260810 06:32:55.174548 10484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:32:55.178153 10484 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:32:55.179226 10484 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Loaded TSK: 0
I20260810 06:32:55.180811 10484 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:32:55.264195 10467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:55.264596 10467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:55.264673 10467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:55.269762 10467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:55.269850 10467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:55.269937 10467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:32:55.276176 10467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.195.212:55989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:39745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=35215
--tserver_master_addrs=127.21.195.254:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:55.277558 10467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:55.278757 10467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:55.292193 10522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:55.292644 10467 server_base.cc:1034] running on GCE node
W20260810 06:32:55.292346 10521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:55.293660 10525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:55.294292 10467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:55.295277 10467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:55.296494 10467 hybrid_clock.cc:648] HybridClock initialized: now 1786343575296470 us; error 45 us; skew 500 ppm
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:55.300565 10467 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:32:55.302062 10467 webserver.cc:460] Webserver started at http://127.21.195.193:35215/ using document root <none> and password file <none>
I20260810 06:32:55.302906 10467 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:55.303041 10467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:55.338673 10467 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260810 06:32:55.344034 10537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.345964 10467 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.002s
I20260810 06:32:55.346150 10467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "375612155bd14d4ea1e25fe5fba42b77"
format_stamp: "Formatted at 2026-08-10 06:32:53 on dist-test-slave-7lbf"
server_key: "8926b3a96703102f22b3caa4fedabf4f"
server_key_iv: "b1d34ca2d97de5ae491fcdca5a71b871"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:55.347021 10467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:55.362706 10467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:55.367817 10467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:55.368162 10467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:55.369122 10467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:55.370668 10467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:55.370805 10467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260810 06:32:55.370978 10467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:55.371182 10467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.383489 10467 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:39745
I20260810 06:32:55.384896 10714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:39745 every 8 connection(s)
I20260810 06:32:55.385361 10467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:32:55.391681 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 10467
I20260810 06:32:55.392282 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:55989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:43835
--local_ip_for_outbound_sockets=127.21.195.194
--tserver_master_addrs=127.21.195.254:46863
--webserver_port=41627
--webserver_interface=127.21.195.194
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.195.212:55989/kms with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:55.415257 10720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:55.388787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46863 (local address 127.21.195.193:58871)
0810 06:32:55.389797 (+ 1010us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:55.389858 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:55.391039 (+ 1181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:55.393848 (+ 2809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:55.393859 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:55.394283 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:55.395069 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:55.395091 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.397714 (+ 2623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.397718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:55.399245 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:55.399259 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.400730 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.400735 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:55.401045 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:55.402065 (+ 1020us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:55.402092 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:55.404027 (+ 1935us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:55.410645 (+ 6618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:55.410655 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:55.410677 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:55.411181 (+ 504us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:55.411699 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:55.411703 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:55.411705 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:55.411919 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:55.412927 (+ 1008us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:55.412935 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:55.413325 (+ 390us) client_negotiation.cc:769] Sending connection context
0810 06:32:55.413586 (+ 261us) client_negotiation.cc:240] Negotiation successful
0810 06:32:55.414010 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"thread_start_us":148,"threads_started":1}
I20260810 06:32:55.417555 10717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:55.388660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:58871 (local address 127.21.195.254:46863)
0810 06:32:55.389425 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:55.389450 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:55.390009 (+ 559us) server_negotiation.cc:407] Connection header received
0810 06:32:55.392631 (+ 2622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:55.392651 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:55.393184 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:55.395356 (+ 2172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:55.395691 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.397498 (+ 1807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.399416 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.400252 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.400444 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:55.404335 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:55.404343 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:55.404367 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:55.404409 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:55.410375 (+ 5966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:55.411362 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:55.411370 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:55.411378 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:55.411572 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:55.412064 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:55.412068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:55.412070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:55.412701 (+ 631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:55.412856 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:55.415944 (+ 3088us) server_negotiation.cc:299] Negotiation successful
0810 06:32:55.416356 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":150,"threads_started":1}
I20260810 06:32:55.420596 10715 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46863
I20260810 06:32:55.420933 10715 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.421713 10715 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
W20260810 06:32:55.424458 10715 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:46863 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 06:32:55.424614 10715 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.424845 10715 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:55.426335 10715 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.426573 10715 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
W20260810 06:32:55.427757 10715 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:32:55.553228 10721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:55.553587 10721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:55.553653 10721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:55.558372 10721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:55.558457 10721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:55.558545 10721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:32:55.564543 10721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.195.212:55989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:43835
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=41627
--tserver_master_addrs=127.21.195.254:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:55.566054 10721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:55.567308 10721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:55.578229 10736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:55.578229 10733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:55.578600 10734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:55.578954 10721 server_base.cc:1034] running on GCE node
I20260810 06:32:55.579558 10721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:55.580289 10721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:55.581482 10721 hybrid_clock.cc:648] HybridClock initialized: now 1786343575581465 us; error 30 us; skew 500 ppm
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:55.584781 10721 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:32:55.585922 10721 webserver.cc:460] Webserver started at http://127.21.195.194:41627/ using document root <none> and password file <none>
I20260810 06:32:55.586565 10721 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:55.586661 10721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:55.608476 10721 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:32:55.611986 10747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.613555 10721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:32:55.613703 10721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "c7eecd5aac1147489760ddbb4cbae657"
format_stamp: "Formatted at 2026-08-10 06:32:54 on dist-test-slave-7lbf"
server_key: "587ceecb09067ae30e79413b9a06471b"
server_key_iv: "e9fec4055c0928c63cbbdb3503f2d3c5"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:55.614445 10721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:55.634775 10721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:55.639123 10721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:55.639379 10721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:55.640270 10721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:55.641666 10721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:55.641755 10721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.641824 10721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:55.641850 10721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.653559 10721 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:43835
I20260810 06:32:55.653774 10923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:43835 every 8 connection(s)
I20260810 06:32:55.654963 10721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:32:55.660859 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 10721
I20260810 06:32:55.661407 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.195.212:55989/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:36091
--local_ip_for_outbound_sockets=127.21.195.195
--tserver_master_addrs=127.21.195.254:46863
--webserver_port=37209
--webserver_interface=127.21.195.195
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:37621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.195.212:55989/kms with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:55.679735 10717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:55.657131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:40357 (local address 127.21.195.254:46863)
0810 06:32:55.657282 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:55.657286 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:55.658608 (+ 1322us) server_negotiation.cc:407] Connection header received
0810 06:32:55.659661 (+ 1053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:55.659665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:55.659732 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:55.659811 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:55.661577 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.662304 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.664344 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.664732 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.664861 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:55.674665 (+ 9804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:55.674671 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:55.674674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:55.674715 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:55.676629 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:55.677599 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:55.677605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:55.677607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:55.677717 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:55.678233 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:55.678237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:55.678239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:55.678496 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:55.678580 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:55.679363 (+ 783us) server_negotiation.cc:299] Negotiation successful
0810 06:32:55.679528 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:32:55.681658 10927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:55.657840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46863 (local address 127.21.195.194:40357)
0810 06:32:55.658425 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:55.658487 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:55.659419 (+ 932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:55.660059 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:55.660070 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:55.660497 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:55.661313 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:55.661336 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.662517 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.662520 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:55.664149 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:55.664163 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.665598 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.665602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:55.665790 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:55.672175 (+ 6385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:55.672210 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:55.674316 (+ 2106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:55.676873 (+ 2557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:55.676896 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:55.676923 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:55.677407 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:55.677859 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:55.677863 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:55.677865 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:55.678116 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:55.678655 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:55.678664 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:55.679063 (+ 399us) client_negotiation.cc:769] Sending connection context
0810 06:32:55.680046 (+ 983us) client_negotiation.cc:240] Negotiation successful
0810 06:32:55.680466 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":159,"threads_started":1}
I20260810 06:32:55.683251 10924 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46863
I20260810 06:32:55.683555 10924 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.684211 10924 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
W20260810 06:32:55.686205 10924 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:46863 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 06:32:55.686353 10924 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.686570 10924 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:55.687525 10924 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.687741 10924 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
W20260810 06:32:55.688624 10924 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:32:55.834599 10928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:55.834901 10928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:55.834945 10928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:55.839371 10928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:55.839460 10928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:55.839546 10928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:32:55.846690 10928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:37621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.195.212:55989/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:36091
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=37209
--tserver_master_addrs=127.21.195.254:46863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:55.848363 10928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:55.849967 10928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:55.864173 10946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:55.864514 10949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:55.864526 10947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:55.866362 10928 server_base.cc:1034] running on GCE node
I20260810 06:32:55.866991 10928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:55.867950 10928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:55.869166 10928 hybrid_clock.cc:648] HybridClock initialized: now 1786343575869125 us; error 59 us; skew 500 ppm
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:55.873327 10928 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:32:55.874925 10928 webserver.cc:460] Webserver started at http://127.21.195.195:37209/ using document root <none> and password file <none>
I20260810 06:32:55.875875 10928 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:55.876017 10928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:55.899327 10928 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:32:55.902619 10961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.904225 10928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:32:55.904371 10928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "8dc4c6e243e34d3299064e5dc1d7f977"
format_stamp: "Formatted at 2026-08-10 06:32:54 on dist-test-slave-7lbf"
server_key: "4244ab8948a6280a300bdc2e3f18d691"
server_key_iv: "cdf71f545375df7a30c995610bc804f3"
server_key_version: "kuduclusterkey@0"
I20260810 06:32:55.905011 10928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:32:55.944816 10928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:32:55.948284 10928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:32:55.948500 10928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:32:55.949236 10928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:32:55.950289 10928 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:32:55.950346 10928 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.950412 10928 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:32:55.950441 10928 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:32:55.968016 10928 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:36091
I20260810 06:32:55.969277 10928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:32:55.970168 11159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:36091 every 8 connection(s)
I20260810 06:32:55.978217 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 10928
Aug 10 06:32:55 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343575, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:32:55.985152 10717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:55.973739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:40869 (local address 127.21.195.254:46863)
0810 06:32:55.973875 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:55.973879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:55.973909 (+ 30us) server_negotiation.cc:407] Connection header received
0810 06:32:55.974474 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:55.974478 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:55.974541 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:55.974622 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:55.975903 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.976444 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.977719 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.978107 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.978237 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:55.981099 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:55.981102 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:55.981104 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:55.981135 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:55.982684 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:55.983214 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:55.983218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:55.983220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:55.983307 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:55.983758 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:55.983762 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:55.983764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:55.984079 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:55.984197 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:55.984842 (+ 645us) server_negotiation.cc:299] Negotiation successful
0810 06:32:55.984974 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59,"spinlock_wait_cycles":768}
I20260810 06:32:55.986398 11167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:55.972591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:46863 (local address 127.21.195.195:40869)
0810 06:32:55.973142 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:55.973202 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:55.974234 (+ 1032us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:55.974847 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:55.974856 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:55.975161 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:32:55.975721 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:55.975738 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.976583 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.976587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:55.977567 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:55.977581 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.978443 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.978448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:55.978681 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:55.979452 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:32:55.979476 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:32:55.980914 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:32:55.982801 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:55.982808 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:55.982828 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:55.983114 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:55.983415 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:32:55.983418 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:32:55.983420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:32:55.983637 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:32:55.984205 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:32:55.984212 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:32:55.984568 (+ 356us) client_negotiation.cc:769] Sending connection context
0810 06:32:55.984775 (+ 207us) client_negotiation.cc:240] Negotiation successful
0810 06:32:55.985164 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":128,"threads_started":1}
I20260810 06:32:55.988250 11160 heartbeater.cc:347] Connected to a master server at 127.21.195.254:46863
I20260810 06:32:55.988525 11160 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.989077 11160 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:55.990629 11168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:55.978994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34658 (local address 127.21.195.254:46863)
0810 06:32:55.979388 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:55.979392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:55.979731 (+ 339us) server_negotiation.cc:407] Connection header received
0810 06:32:55.979963 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:55.979967 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:55.980030 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:55.980094 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:55.981171 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.981933 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.983376 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:55.983725 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:55.983819 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:55.985586 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:55.985590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:55.985592 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:55.985618 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:55.987327 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:55.987832 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:55.987835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:55.987837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:55.987933 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:55.989599 (+ 1666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:55.989603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:55.989604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:55.989842 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:55.990069 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:55.990287 (+ 218us) server_negotiation.cc:299] Negotiation successful
0810 06:32:55.990432 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"spinlock_wait_cycles":33152,"thread_start_us":126,"threads_started":1}
W20260810 06:32:55.990931 11160 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:46863 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 06:32:55.991068 11160 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.991257 11160 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:55.992092 11160 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:55.992276 11160 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
W20260810 06:32:55.993398 11160 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 06:32:56 dist-test-slave-7lbf krb5kdc[8818](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786343576, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:56.428037 10715 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:56.428365 10715 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:56.429960 10403 ts_manager.cc:194] Registered new tserver with Master: 375612155bd14d4ea1e25fe5fba42b77 (127.21.195.193:39745)
I20260810 06:32:56.431679 10403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:58871
I20260810 06:32:56.688980 10924 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:56.689316 10924 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:56.690412 10403 ts_manager.cc:194] Registered new tserver with Master: c7eecd5aac1147489760ddbb4cbae657 (127.21.195.194:43835)
I20260810 06:32:56.691287 10403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:40357
Aug 10 06:32:56 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343576, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:56.993688 11160 heartbeater.cc:464] Registering TS with master...
I20260810 06:32:56.994081 11160 heartbeater.cc:511] Master 127.21.195.254:46863 requested a full tablet report, sending...
I20260810 06:32:56.995229 10405 ts_manager.cc:194] Registered new tserver with Master: 8dc4c6e243e34d3299064e5dc1d7f977 (127.21.195.195:36091)
I20260810 06:32:56.996176 10405 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:40869
I20260810 06:32:57.003005 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:32:57.015700 11195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.005266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34664 (local address 127.21.195.254:46863)
0810 06:32:57.006057 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.006061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.006077 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:32:57.006127 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.006130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.006185 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.007252 (+ 1067us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:32:57.007366 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.007916 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.009126 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.009479 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.009630 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.011514 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:32:57.011518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:32:57.011521 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:32:57.011556 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:32:57.013577 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:57.014180 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:57.014184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:57.014185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:57.014293 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:32:57.014601 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:32:57.014605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:32:57.014606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:32:57.014830 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:32:57.014974 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.015340 (+ 366us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.015513 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":102,"threads_started":1}
I20260810 06:32:57.020932 10405 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:32:57.026630 10405 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 10 06:32:57 dist-test-slave-7lbf krb5kdc[8818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343576, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for HTTP/127.21.195.212@KRBTEST.COM
I20260810 06:32:57.067962 11212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.047340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58226 (local address 127.21.195.195:36091)
0810 06:32:57.049023 (+ 1683us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.049031 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.052724 (+ 3693us) server_negotiation.cc:407] Connection header received
0810 06:32:57.056818 (+ 4094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.056826 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.057102 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.057267 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:57.057778 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.058969 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.065783 (+ 6814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.066736 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.066860 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.067028 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.067646 (+ 618us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.067782 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1560,"thread_start_us":162,"threads_started":1}
I20260810 06:32:57.068559 11206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.046865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:36091 (local address 127.0.0.1:58226)
0810 06:32:57.052607 (+ 5742us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.052621 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:57.056625 (+ 4004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:57.057477 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:57.057480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:57.057496 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:57.057627 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.057633 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.059133 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.059136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.060535 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.060545 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.067148 (+ 6603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.067152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.067333 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.067395 (+ 62us) client_negotiation.cc:769] Sending connection context
0810 06:32:57.068220 (+ 825us) client_negotiation.cc:240] Negotiation successful
0810 06:32:57.068418 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5673,"thread_start_us":106,"threads_started":1}
I20260810 06:32:57.070410 11211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.044735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:43835 (local address 127.0.0.1:52030)
0810 06:32:57.048466 (+ 3731us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.048536 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:57.048697 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:57.052862 (+ 4165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:57.052871 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:57.052901 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:57.053094 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.053102 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.060704 (+ 7602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.060708 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.061907 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.061919 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.069936 (+ 8017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.069940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.070064 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.070094 (+ 30us) client_negotiation.cc:769] Sending connection context
0810 06:32:57.070154 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:32:57.070243 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3490,"thread_start_us":140,"threads_started":1}
I20260810 06:32:57.071197 11208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.046092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39745 (local address 127.0.0.1:41332)
0810 06:32:57.049171 (+ 3079us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.049184 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:57.049297 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:57.054832 (+ 5535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:57.054836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:57.054859 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:57.054966 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.054972 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.062071 (+ 7099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.062074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.063216 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.063227 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.070792 (+ 7565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.070796 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.070896 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.070923 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 06:32:57.070979 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 06:32:57.071059 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3016,"thread_start_us":121,"threads_started":1}
I20260810 06:32:57.072028 11207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.044983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52030 (local address 127.21.195.194:43835)
0810 06:32:57.051977 (+ 6994us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.051985 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.052009 (+ 24us) server_negotiation.cc:407] Connection header received
0810 06:32:57.052088 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.052094 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.052344 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.053300 (+ 956us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:57.053471 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.054658 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.063419 (+ 8761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.064420 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.071469 (+ 7049us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.071669 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.071739 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.071860 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6871,"thread_start_us":129,"threads_started":1}
I20260810 06:32:57.072780 11210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.046259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41332 (local address 127.21.195.193:39745)
0810 06:32:57.051211 (+ 4952us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.051219 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.051248 (+ 29us) server_negotiation.cc:407] Connection header received
0810 06:32:57.051352 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.051358 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.051650 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.055146 (+ 3496us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:57.055327 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.056473 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.064620 (+ 8147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.065607 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.072311 (+ 6704us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.072476 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.072530 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.072637 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4820,"thread_start_us":96,"threads_started":1}
I20260810 06:32:57.072846 11039 tablet_service.cc:1467] Processing CreateTablet for tablet 8b75ed92b76f48f39d820c1cb69fab1d (DEFAULT_TABLE table=test-table [id=b98071f70fc94578813f0c99864d0c21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:32:57.074492 11039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b75ed92b76f48f39d820c1cb69fab1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:32:57.075577 10820 tablet_service.cc:1467] Processing CreateTablet for tablet 8b75ed92b76f48f39d820c1cb69fab1d (DEFAULT_TABLE table=test-table [id=b98071f70fc94578813f0c99864d0c21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:32:57.075863 10613 tablet_service.cc:1467] Processing CreateTablet for tablet 8b75ed92b76f48f39d820c1cb69fab1d (DEFAULT_TABLE table=test-table [id=b98071f70fc94578813f0c99864d0c21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:32:57.076855 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b75ed92b76f48f39d820c1cb69fab1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:32:57.076855 10820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b75ed92b76f48f39d820c1cb69fab1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:32:57.084519 11214 tablet_bootstrap.cc:492] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Bootstrap starting.
I20260810 06:32:57.087311 11214 tablet_bootstrap.cc:654] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Neither blocks nor log segments found. Creating new log.
I20260810 06:32:57.088347 11214 log.cc:824] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:57.089442 11218 tablet_bootstrap.cc:492] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77: Bootstrap starting.
I20260810 06:32:57.091349 11214 tablet_bootstrap.cc:492] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: No bootstrap required, opened a new log
I20260810 06:32:57.091581 11214 ts_tablet_manager.cc:1397] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260810 06:32:57.092417 11218 tablet_bootstrap.cc:654] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77: Neither blocks nor log segments found. Creating new log.
I20260810 06:32:57.093393 11218 log.cc:824] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:57.094292 11224 tablet_bootstrap.cc:492] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: Bootstrap starting.
I20260810 06:32:57.096163 11214 raft_consensus.cc:348] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.096462 11214 raft_consensus.cc:374] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:32:57.096513 11214 raft_consensus.cc:729] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc4c6e243e34d3299064e5dc1d7f977, State: Initialized, Role: FOLLOWER
I20260810 06:32:57.097150 11214 consensus_queue.cc:260] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.098547 11214 ts_tablet_manager.cc:1428] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 06:32:57.099045 11160 heartbeater.cc:503] Master 127.21.195.254:46863 was elected leader, sending a full tablet report...
I20260810 06:32:57.109683 11218 tablet_bootstrap.cc:492] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77: No bootstrap required, opened a new log
I20260810 06:32:57.110086 11224 tablet_bootstrap.cc:654] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: Neither blocks nor log segments found. Creating new log.
I20260810 06:32:57.110146 11218 ts_tablet_manager.cc:1397] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.004s
I20260810 06:32:57.111315 11224 log.cc:824] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: Log is configured to *not* fsync() on all Append() calls
I20260810 06:32:57.114768 11224 tablet_bootstrap.cc:492] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: No bootstrap required, opened a new log
I20260810 06:32:57.115028 11224 ts_tablet_manager.cc:1397] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.003s
I20260810 06:32:57.120042 11224 raft_consensus.cc:348] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.120076 11218 raft_consensus.cc:348] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.120360 11224 raft_consensus.cc:374] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:32:57.120373 11218 raft_consensus.cc:374] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:32:57.120431 11218 raft_consensus.cc:729] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 375612155bd14d4ea1e25fe5fba42b77, State: Initialized, Role: FOLLOWER
I20260810 06:32:57.120437 11224 raft_consensus.cc:729] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7eecd5aac1147489760ddbb4cbae657, State: Initialized, Role: FOLLOWER
I20260810 06:32:57.120939 11224 consensus_queue.cc:260] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.121023 11218 consensus_queue.cc:260] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.121762 10924 heartbeater.cc:503] Master 127.21.195.254:46863 was elected leader, sending a full tablet report...
I20260810 06:32:57.122224 11224 ts_tablet_manager.cc:1428] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 06:32:57.122346 11218 ts_tablet_manager.cc:1428] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20260810 06:32:57.122740 10715 heartbeater.cc:503] Master 127.21.195.254:46863 was elected leader, sending a full tablet report...
W20260810 06:32:57.138116 10716 tablet.cc:2369] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:32:57.157253 10926 tablet.cc:2369] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:32:57.221740 11166 tablet.cc:2369] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:32:57.323002 11226 raft_consensus.cc:482] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:32:57.323277 11226 raft_consensus.cc:504] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.324862 11226 leader_election.cc:288] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7eecd5aac1147489760ddbb4cbae657 (127.21.195.194:43835), 375612155bd14d4ea1e25fe5fba42b77 (127.21.195.193:39745)
I20260810 06:32:57.332067 11228 raft_consensus.cc:482] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:32:57.332304 11228 raft_consensus.cc:504] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.333906 11228 leader_election.cc:288] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 375612155bd14d4ea1e25fe5fba42b77 (127.21.195.193:39745), 8dc4c6e243e34d3299064e5dc1d7f977 (127.21.195.195:36091)
I20260810 06:32:57.337425 11210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.326670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:35423 (local address 127.21.195.193:39745)
0810 06:32:57.326836 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.326840 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.328279 (+ 1439us) server_negotiation.cc:407] Connection header received
0810 06:32:57.328552 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.328557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.328613 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.328668 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:57.329304 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.330070 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.335894 (+ 5824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.336568 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.336678 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.336737 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.337168 (+ 431us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.337277 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 06:32:57.338246 11232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.325891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39745 (local address 127.21.195.195:35423)
0810 06:32:57.328176 (+ 2285us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.328190 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:57.328384 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:57.328835 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:57.328838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:57.328858 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:57.329146 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.329156 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.330207 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.330210 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.331643 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.331654 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.336855 (+ 5201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.336859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.336982 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.337010 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 06:32:57.337956 (+ 946us) client_negotiation.cc:240] Negotiation successful
0810 06:32:57.338062 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2214,"thread_start_us":139,"threads_started":1}
I20260810 06:32:57.339574 10616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b75ed92b76f48f39d820c1cb69fab1d" candidate_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "375612155bd14d4ea1e25fe5fba42b77" is_pre_election: true
I20260810 06:32:57.340047 10616 raft_consensus.cc:2454] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc4c6e243e34d3299064e5dc1d7f977 in term 0.
I20260810 06:32:57.340147 11207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.326525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:35879 (local address 127.21.195.194:43835)
0810 06:32:57.326707 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.326712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.327927 (+ 1215us) server_negotiation.cc:407] Connection header received
0810 06:32:57.329755 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.329760 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.329811 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.329856 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:57.330287 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.331043 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.338711 (+ 7668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.339327 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.339425 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.339480 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.339932 (+ 452us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.340030 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 06:32:57.340581 11231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.325359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:43835 (local address 127.21.195.195:35879)
0810 06:32:57.327814 (+ 2455us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.327832 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:57.329604 (+ 1772us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:57.329989 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:57.329991 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:57.330006 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:57.330149 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.330156 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.331186 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.331189 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.332296 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.332307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.339650 (+ 7343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.339654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.339782 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.339808 (+ 26us) client_negotiation.cc:769] Sending connection context
0810 06:32:57.340337 (+ 529us) client_negotiation.cc:240] Negotiation successful
0810 06:32:57.340435 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2368,"thread_start_us":179,"threads_started":1}
I20260810 06:32:57.340662 10964 leader_election.cc:302] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 375612155bd14d4ea1e25fe5fba42b77, 8dc4c6e243e34d3299064e5dc1d7f977; no voters:
I20260810 06:32:57.341035 11226 raft_consensus.cc:2781] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:32:57.341128 11226 raft_consensus.cc:482] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:32:57.341169 11226 raft_consensus.cc:3037] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:32:57.341269 10835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b75ed92b76f48f39d820c1cb69fab1d" candidate_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7eecd5aac1147489760ddbb4cbae657" is_pre_election: true
I20260810 06:32:57.341506 10835 raft_consensus.cc:2454] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc4c6e243e34d3299064e5dc1d7f977 in term 0.
I20260810 06:32:57.342806 11226 raft_consensus.cc:504] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.343227 11226 leader_election.cc:288] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [CANDIDATE]: Term 1 election: Requested vote from peers c7eecd5aac1147489760ddbb4cbae657 (127.21.195.194:43835), 375612155bd14d4ea1e25fe5fba42b77 (127.21.195.193:39745)
I20260810 06:32:57.343756 10835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b75ed92b76f48f39d820c1cb69fab1d" candidate_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7eecd5aac1147489760ddbb4cbae657"
I20260810 06:32:57.343904 10835 raft_consensus.cc:3037] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:32:57.345325 10835 raft_consensus.cc:2454] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc4c6e243e34d3299064e5dc1d7f977 in term 1.
I20260810 06:32:57.345772 10963 leader_election.cc:302] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc4c6e243e34d3299064e5dc1d7f977, c7eecd5aac1147489760ddbb4cbae657; no voters:
I20260810 06:32:57.345986 11226 raft_consensus.cc:2781] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:32:57.346215 11226 raft_consensus.cc:686] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc4c6e243e34d3299064e5dc1d7f977, State: Running, Role: LEADER
I20260810 06:32:57.346645 11226 consensus_queue.cc:237] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } }
I20260810 06:32:57.346932 10616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b75ed92b76f48f39d820c1cb69fab1d" candidate_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "375612155bd14d4ea1e25fe5fba42b77"
I20260810 06:32:57.347072 10616 raft_consensus.cc:3037] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:32:57.347980 11233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.334354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39745 (local address 127.21.195.194:50455)
0810 06:32:57.339289 (+ 4935us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.339305 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:57.339483 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:57.339942 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:57.339945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:57.339966 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:57.340112 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.340119 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.344983 (+ 4864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.344986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.346176 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.346188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.347495 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.347499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.347605 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.347630 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:32:57.347695 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:32:57.347782 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4857,"thread_start_us":160,"threads_started":1}
I20260810 06:32:57.348497 11210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.334925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:50455 (local address 127.21.195.193:39745)
0810 06:32:57.337666 (+ 2741us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.337671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.339390 (+ 1719us) server_negotiation.cc:407] Connection header received
0810 06:32:57.339606 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.339609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.339660 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.339705 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:57.344148 (+ 4443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.344825 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.346709 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.347268 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.347382 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.347432 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.348276 (+ 844us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.348368 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2671,"thread_start_us":117,"threads_started":1}
I20260810 06:32:57.348562 10616 raft_consensus.cc:2454] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc4c6e243e34d3299064e5dc1d7f977 in term 1.
I20260810 06:32:57.348863 10616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b75ed92b76f48f39d820c1cb69fab1d" candidate_uuid: "c7eecd5aac1147489760ddbb4cbae657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "375612155bd14d4ea1e25fe5fba42b77" is_pre_election: true
I20260810 06:32:57.349105 10616 raft_consensus.cc:2379] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7eecd5aac1147489760ddbb4cbae657 in current term 1: Already voted for candidate 8dc4c6e243e34d3299064e5dc1d7f977 in this term.
I20260810 06:32:57.349849 11212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.335750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:34379 (local address 127.21.195.195:36091)
0810 06:32:57.335911 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.335916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.342013 (+ 6097us) server_negotiation.cc:407] Connection header received
0810 06:32:57.342198 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.342202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.342250 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.342312 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:32:57.342737 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.343528 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.345242 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.345912 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.346009 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.346062 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.349636 (+ 3574us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.349734 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:32:57.350427 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.335341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:36091 (local address 127.21.195.194:34379)
0810 06:32:57.341908 (+ 6567us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.341925 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:32:57.342086 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:32:57.342449 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:32:57.342451 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:32:57.342471 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:32:57.342610 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.342616 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.343685 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.343688 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.345090 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:32:57.345102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.346161 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.346165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:32:57.346294 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.346316 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 06:32:57.350183 (+ 3867us) client_negotiation.cc:240] Negotiation successful
0810 06:32:57.350279 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6487,"thread_start_us":130,"threads_started":1}
I20260810 06:32:57.351756 11067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b75ed92b76f48f39d820c1cb69fab1d" candidate_uuid: "c7eecd5aac1147489760ddbb4cbae657" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" is_pre_election: true
I20260810 06:32:57.355803 10405 catalog_manager.cc:5495] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc4c6e243e34d3299064e5dc1d7f977 (127.21.195.195). New cstate: current_term: 1 leader_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc4c6e243e34d3299064e5dc1d7f977" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 36091 } health_report { overall_health: HEALTHY } } }
I20260810 06:32:57.357978 10753 leader_election.cc:302] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7eecd5aac1147489760ddbb4cbae657; no voters: 375612155bd14d4ea1e25fe5fba42b77, 8dc4c6e243e34d3299064e5dc1d7f977
I20260810 06:32:57.358601 11228 raft_consensus.cc:2726] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 06:32:57.372546 11212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.366866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58242 (local address 127.21.195.195:36091)
0810 06:32:57.366999 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 06:32:57.367004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:32:57.367021 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:32:57.367263 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:32:57.367267 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:32:57.367352 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:32:57.367480 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:32:57.367902 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.368672 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.370014 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:32:57.370384 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:32:57.370520 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:32:57.371034 (+ 514us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:32:57.371729 (+ 695us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:32:57.371885 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 06:32:57.372285 (+ 400us) server_negotiation.cc:299] Negotiation successful
0810 06:32:57.372359 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 06:32:57.382043 10616 raft_consensus.cc:1261] T 8b75ed92b76f48f39d820c1cb69fab1d P 375612155bd14d4ea1e25fe5fba42b77 [term 1 FOLLOWER]: Refusing update from remote peer 8dc4c6e243e34d3299064e5dc1d7f977: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:32:57.382177 10835 raft_consensus.cc:1261] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 1 FOLLOWER]: Refusing update from remote peer 8dc4c6e243e34d3299064e5dc1d7f977: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:32:57.382998 11239 consensus_queue.cc:1035] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7eecd5aac1147489760ddbb4cbae657" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 43835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:32:57.383329 11226 consensus_queue.cc:1035] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "375612155bd14d4ea1e25fe5fba42b77" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 39745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:32:57.394778 11254 mvcc.cc:205] Tried to move back new op lower bound from 7316863292947382272 to 7316863292816334848. Current Snapshot: MvccSnapshot[applied={T|T < 7316863292947382272}]
I20260810 06:32:57.395897 11256 mvcc.cc:205] Tried to move back new op lower bound from 7316863292947382272 to 7316863292816334848. Current Snapshot: MvccSnapshot[applied={T|T < 7316863292947382272}]
I20260810 06:32:57.406224 11258 mvcc.cc:205] Tried to move back new op lower bound from 7316863292947382272 to 7316863292816334848. Current Snapshot: MvccSnapshot[applied={T|T < 7316863292947382272}]
I20260810 06:32:57.406657 10405 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:32:57.406832 10405 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:32:57.409859 10405 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4131aa85087942ae8db86c4ab7712bbe: Sending DeleteTablet for 3 replicas of tablet 8b75ed92b76f48f39d820c1cb69fab1d
I20260810 06:32:57.411274 10820 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b75ed92b76f48f39d820c1cb69fab1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:32:57 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:52030
I20260810 06:32:57.411978 11039 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b75ed92b76f48f39d820c1cb69fab1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:32:57 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:58226
I20260810 06:32:57.412972 10613 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b75ed92b76f48f39d820c1cb69fab1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:32:57 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:41332
I20260810 06:32:57.414408 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 10467
I20260810 06:32:57.453979 11274 tablet_replica.cc:330] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: stopping tablet replica
I20260810 06:32:57.454382 11272 tablet_replica.cc:330] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: stopping tablet replica
I20260810 06:32:57.454902 11272 raft_consensus.cc:2229] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:32:57.455333 11274 raft_consensus.cc:2229] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:32:57.455868 11272 raft_consensus.cc:2258] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:32:57.456452 11274 raft_consensus.cc:2258] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:32:57.459313 11274 ts_tablet_manager.cc:1905] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:32:57.460547 11272 ts_tablet_manager.cc:1905] T 8b75ed92b76f48f39d820c1cb69fab1d P c7eecd5aac1147489760ddbb4cbae657: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:32:57.464012 11274 ts_tablet_manager.cc:1918] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260810 06:32:57.464766 10381 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:39745 (error 108)
I20260810 06:32:57.464886 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 10721
I20260810 06:32:57.483669 11206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.483250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39745 (local address 127.0.0.1:41342)
0810 06:32:57.483477 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.483564 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:39745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260810 06:32:57.484047 10381 catalog_manager.cc:4584] TS 375612155bd14d4ea1e25fe5fba42b77 (127.21.195.193:39745): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b75ed92b76f48f39d820c1cb69fab1d: Network error: Client connection negotiation failed: client connection to 127.21.195.193:39745: connect: Connection refused (error 111)
I20260810 06:32:57.520140 11274 log.cc:1196] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/8b75ed92b76f48f39d820c1cb69fab1d
I20260810 06:32:57.520710 11274 ts_tablet_manager.cc:1939] T 8b75ed92b76f48f39d820c1cb69fab1d P 8dc4c6e243e34d3299064e5dc1d7f977: Deleting consensus metadata
I20260810 06:32:57.522738 10383 catalog_manager.cc:4841] TS 8dc4c6e243e34d3299064e5dc1d7f977 (127.21.195.195:36091): tablet 8b75ed92b76f48f39d820c1cb69fab1d (table test-table [id=b98071f70fc94578813f0c99864d0c21]) successfully deleted
I20260810 06:32:57.527179 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 10928
I20260810 06:32:57.531204 11206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.527146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:43835 (local address 127.0.0.1:52034)
0810 06:32:57.530991 (+ 3845us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.531080 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.194:43835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3710}
I20260810 06:32:57.538133 11206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.537804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39745 (local address 127.0.0.1:41346)
0810 06:32:57.537969 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.538037 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:39745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 06:32:57.539067 11206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:32:57.538780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:39745 (local address 127.0.0.1:41350)
0810 06:32:57.538932 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 06:32:57.538989 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:39745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 06:32:57.541893 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 10355
I20260810 06:32:57.572957 22287 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 06:32:57.921293 22287 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 06:32:57.921433 22287 mini_ranger.cc:66] Stopping Ranger...
I20260810 06:32:58.267243 22287 mini_ranger.cc:68] Stopped Ranger
2026-08-10 06:32:58.267 UTC [8874] LOG: received smart shutdown request
2026-08-10 06:32:58.271 UTC [8874] LOG: background worker "logical replication launcher" (PID 8889) exited with exit code 1
2026-08-10 06:32:58.272 UTC [8880] LOG: shutting down
2026-08-10 06:32:58.425 UTC [8874] LOG: database system is shut down
2026-08-10T06:32:58Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51858 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:32:58 dist-test-slave-7lbf krb5kdc[11296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:32:58 dist-test-slave-7lbf krb5kdc[11296](info): set up 2 sockets
Aug 10 06:32:58 dist-test-slave-7lbf krb5kdc[11296](info): commencing operation
krb5kdc: starting...
W20260810 06:32:59.710093 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:32:59 dist-test-slave-7lbf krb5kdc[11296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:32:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:32:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:32:59.842190 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36153
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:39925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:36153,127.21.195.253:39871,127.21.195.252:43477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:32:59.965301 11317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:32:59.965691 11317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:32:59.965755 11317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:32:59.969995 11317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:32:59.970083 11317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:32:59.970111 11317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:32:59.970134 11317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:32:59.970153 11317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:32:59.975986 11317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:39925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:36153,127.21.195.253:39871,127.21.195.252:43477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:36153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:32:59.977285 11317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:32:59.978547 11317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:32:59.987838 11323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:59.987883 11322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:32:59.987891 11325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:32:59.988132 11317 server_base.cc:1034] running on GCE node
I20260810 06:32:59.988905 11317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:32:59.990392 11317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:32:59.991550 11317 hybrid_clock.cc:648] HybridClock initialized: now 1786343579991522 us; error 47 us; skew 500 ppm
Aug 10 06:32:59 dist-test-slave-7lbf krb5kdc[11296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343579, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:32:59.994704 11317 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:32:59.995769 11317 webserver.cc:460] Webserver started at http://127.21.195.254:44515/ using document root <none> and password file <none>
I20260810 06:32:59.996433 11317 fs_manager.cc:359] Metadata directory not provided
I20260810 06:32:59.996503 11317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:32:59.996706 11317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:32:59.999011 11317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "ddcb1f3cd00b4989a1e9a895335a523a"
format_stamp: "Formatted at 2026-08-10 06:32:59 on dist-test-slave-7lbf"
server_key: "2b4644d95a0d0f0f17e568e50ca7fb1f"
server_key_iv: "d03190728d46678715a0aa76b59e30ae"
server_key_version: "encryptionkey@0"
I20260810 06:32:59.999644 11317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "ddcb1f3cd00b4989a1e9a895335a523a"
format_stamp: "Formatted at 2026-08-10 06:32:59 on dist-test-slave-7lbf"
server_key: "2b4644d95a0d0f0f17e568e50ca7fb1f"
server_key_iv: "d03190728d46678715a0aa76b59e30ae"
server_key_version: "encryptionkey@0"
I20260810 06:33:00.003981 11317 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:33:00.006868 11333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:00.008240 11317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:33:00.008379 11317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "ddcb1f3cd00b4989a1e9a895335a523a"
format_stamp: "Formatted at 2026-08-10 06:32:59 on dist-test-slave-7lbf"
server_key: "2b4644d95a0d0f0f17e568e50ca7fb1f"
server_key_iv: "d03190728d46678715a0aa76b59e30ae"
server_key_version: "encryptionkey@0"
I20260810 06:33:00.008492 11317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:00.022651 11317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:00.026048 11317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:00.026235 11317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:00.033893 11317 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:36153
I20260810 06:33:00.034188 11416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:36153 every 8 connection(s)
I20260810 06:33:00.035020 11317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:33:00.038296 11417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:00.040532 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 11317
I20260810 06:33:00.040668 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:33:00.040974 22287 external_mini_cluster.cc:1428] Setting key 016c6ef3702725253dcf42cf268dd135
I20260810 06:33:00.043043 11417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.195.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.253@KRBTEST.COM" created.
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343579, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:00.059685 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.045743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:36153 (local address 127.0.0.1:44712)
0810 06:33:00.046427 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.046494 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.047403 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.048153 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.048159 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.048626 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.048894 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.048909 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.050159 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.050162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.051038 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.051051 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.051718 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.051722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.051839 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.052441 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.052477 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.054396 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.056338 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.056348 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.056361 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.056611 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.056925 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.056929 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.056930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.057050 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.057757 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.057764 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.057928 (+ 164us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.058104 (+ 176us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.058513 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":75,"spinlock_wait_cycles":33536,"thread_start_us":152,"threads_started":1}
I20260810 06:33:00.059685 11422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.045743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44712 (local address 127.21.195.254:36153)
0810 06:33:00.046399 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.046420 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.046634 (+ 214us) server_negotiation.cc:407] Connection header received
0810 06:33:00.047744 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.047749 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.047949 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.048138 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.049052 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.050046 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.051157 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.051550 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.051719 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.054562 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.054569 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.054583 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.054608 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.056224 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.056716 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.056721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.056722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.056837 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.057137 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.057140 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.057142 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.057648 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.057785 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.058180 (+ 395us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.058445 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":151,"threads_started":1}
I20260810 06:33:00.062412 11417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:33:00.063230 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.062913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34414)
0810 06:33:00.063065 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.063150 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260810 06:33:00.063431 11339 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
I20260810 06:33:00.064467 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.064237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34430)
0810 06:33:00.064350 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.064401 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 06:33:00.064599 11417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:39871: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab.
Entry for principal kudu/127.21.195.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab.
I20260810 06:33:00.069219 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.253:39871
--webserver_interface=127.21.195.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab
--principal=kudu/127.21.195.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:39925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:36153,127.21.195.253:39871,127.21.195.252:43477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:00.113850 11417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } attempt: 1
I20260810 06:33:00.114825 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.114464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34438)
0810 06:33:00.114638 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.114722 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 06:33:00.115608 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.115362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34442)
0810 06:33:00.115475 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.115531 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:33:00.115751 11417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:39871: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
I20260810 06:33:00.183947 11417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } attempt: 2
I20260810 06:33:00.184917 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.184534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34450)
0810 06:33:00.184718 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.184800 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260810 06:33:00.185717 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.185446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34462)
0810 06:33:00.185584 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.185646 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:33:00.185879 11417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:39871: Network error: Client connection negotiation failed: client connection to 127.21.195.253:39871: connect: Connection refused (error 111)
W20260810 06:33:00.194692 11427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:00.195034 11427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:00.195077 11427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:00.199415 11427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:33:00.199501 11427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:00.199520 11427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:00.199536 11427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:33:00.199551 11427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:33:00.205389 11427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:39925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:36153,127.21.195.253:39871,127.21.195.252:43477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab
--principal=kudu/127.21.195.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.253:39871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.195.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:00.206707 11427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:00.207891 11427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:00.217399 11441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:00.217470 11438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:00.217634 11427 server_base.cc:1034] running on GCE node
W20260810 06:33:00.217414 11439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:00.218405 11427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:00.219744 11427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:00.220928 11427 hybrid_clock.cc:648] HybridClock initialized: now 1786343580220907 us; error 39 us; skew 500 ppm
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343580, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:00.224176 11427 init.cc:377] Logged in from keytab as kudu/127.21.195.253@KRBTEST.COM (short username kudu)
I20260810 06:33:00.225368 11427 webserver.cc:460] Webserver started at http://127.21.195.253:45641/ using document root <none> and password file <none>
I20260810 06:33:00.226027 11427 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:00.226109 11427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:00.226342 11427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:00.228719 11427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/data/instance:
uuid: "c8e7db46630f4bbd9e64c739cae8f407"
format_stamp: "Formatted at 2026-08-10 06:33:00 on dist-test-slave-7lbf"
server_key: "180c90d11facd4a8194f85ca599a9a90"
server_key_iv: "2ccaf4ddfef8e4b99ef8c421b8e64677"
server_key_version: "encryptionkey@0"
I20260810 06:33:00.229336 11427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/wal/instance:
uuid: "c8e7db46630f4bbd9e64c739cae8f407"
format_stamp: "Formatted at 2026-08-10 06:33:00 on dist-test-slave-7lbf"
server_key: "180c90d11facd4a8194f85ca599a9a90"
server_key_iv: "2ccaf4ddfef8e4b99ef8c421b8e64677"
server_key_version: "encryptionkey@0"
I20260810 06:33:00.233647 11427 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:33:00.236418 11454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:00.237933 11427 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:00.238062 11427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/wal
uuid: "c8e7db46630f4bbd9e64c739cae8f407"
format_stamp: "Formatted at 2026-08-10 06:33:00 on dist-test-slave-7lbf"
server_key: "180c90d11facd4a8194f85ca599a9a90"
server_key_iv: "2ccaf4ddfef8e4b99ef8c421b8e64677"
server_key_version: "encryptionkey@0"
I20260810 06:33:00.238171 11427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:00.265851 11427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:00.269560 11427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:00.269767 11427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:00.277051 11417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } attempt: 3
I20260810 06:33:00.277237 11427 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.253:39871
I20260810 06:33:00.277606 11540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.253:39871 every 8 connection(s)
I20260810 06:33:00.278568 11427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
I20260810 06:33:00.282346 11545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343579, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:33:00.287283 11545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:33:00.287806 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 11427
I20260810 06:33:00.287925 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-1/wal/instance
I20260810 06:33:00.288228 22287 external_mini_cluster.cc:1428] Setting key 3226bafb3586fe823365afe073b0b0ba
I20260810 06:33:00.291878 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.277748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34466)
0810 06:33:00.277908 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.277926 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.278036 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.280942 (+ 2906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.280945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.281127 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.281260 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.281267 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.283226 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.283230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.283837 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.283850 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.284883 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.284887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.284986 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.285554 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.285573 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.287008 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.289581 (+ 2573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.289584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.289587 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.289903 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.290449 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.290453 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.290455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.290594 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.291274 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.291277 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.291391 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.291503 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.291666 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 06:33:00.293036 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.278596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34466 (local address 127.21.195.253:39871)
0810 06:33:00.279077 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.279099 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.279152 (+ 53us) server_negotiation.cc:407] Connection header received
0810 06:33:00.280067 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.280093 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.280564 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.280994 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.281467 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.283044 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.283997 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.284720 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.284896 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.287245 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.287251 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.287267 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.287300 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.289405 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.290049 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.290055 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.290062 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.290212 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.290709 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.290711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.290713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.291154 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.291283 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.291682 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.292180 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":145,"threads_started":1}
I20260810 06:33:00.295187 11417 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343580, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:00.295955 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.295696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40228)
0810 06:33:00.295829 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.295886 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 06:33:00.296657 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.296409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40242)
0810 06:33:00.296542 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.296594 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260810 06:33:00.296819 11417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:43477: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.21.195.252@KRBTEST.COM; defaulting to no policy
I20260810 06:33:00.300518 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.289324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:36153 (local address 127.0.0.1:44722)
0810 06:33:00.289843 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.289899 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.290075 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.290543 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.290549 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.291005 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.291168 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.291176 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.292249 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.292252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.293148 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.293160 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.293899 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.293903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.294055 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.294644 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.294661 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.296479 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.298710 (+ 2231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.298722 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.298731 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.299060 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.299328 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.299331 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.299333 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.299452 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.299899 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.299906 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.300040 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.300174 (+ 134us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.300360 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":165,"threads_started":1}
I20260810 06:33:00.300534 11422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.289388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44722 (local address 127.21.195.254:36153)
0810 06:33:00.289567 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.289572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.289979 (+ 407us) server_negotiation.cc:407] Connection header received
0810 06:33:00.290179 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.290183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.290231 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.290282 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.291312 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.292078 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.293289 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.293656 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.293733 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.296624 (+ 2891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.296628 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.296630 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.296657 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.298576 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.299161 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.299164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.299165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.299245 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.299587 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.299590 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.299591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.299793 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.299875 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.300233 (+ 358us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.300412 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 06:33:00.301914 11545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.252@KRBTEST.COM" created.
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343580, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:33:00.309916 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.302505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34482 (local address 127.21.195.253:39871)
0810 06:33:00.302600 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.302604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.302616 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:33:00.302734 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.302736 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.302774 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.302836 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.303217 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.303721 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.304474 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.304702 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.304791 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.306943 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.306947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.306948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.306970 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.308308 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.308699 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.308702 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.308705 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.308777 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.309024 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.309027 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.309029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.309216 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.309300 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.309564 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.309717 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":43}
I20260810 06:33:00.309916 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.302440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34482)
0810 06:33:00.302560 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.302575 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.302654 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.302856 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.302859 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.303020 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.303114 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.303119 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.303819 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.303822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.304364 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.304371 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.304800 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.304804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.304893 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.305345 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.305358 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.306812 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.308416 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.308419 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.308421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.308613 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.308856 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.308859 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.308861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.308947 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.309304 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.309307 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.309394 (+ 87us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.309480 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.309779 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":96}
I20260810 06:33:00.310715 11545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:33:00.311491 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.311196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40244)
0810 06:33:00.311316 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.311413 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 06:33:00.311736 11458 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
I20260810 06:33:00.312747 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.312524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40254)
0810 06:33:00.312634 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.312684 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 06:33:00.312882 11545 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:43477: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab.
Entry for principal kudu/127.21.195.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab.
I20260810 06:33:00.318738 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.252:43477
--webserver_interface=127.21.195.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab
--principal=kudu/127.21.195.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:39925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:36153,127.21.195.253:39871,127.21.195.252:43477
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:00.327994 11417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } attempt: 1
I20260810 06:33:00.329037 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.328677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40268)
0810 06:33:00.328860 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.328945 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 06:33:00.329843 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.329606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40280)
0810 06:33:00.329714 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.329772 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 06:33:00.329975 11417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:43477: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
I20260810 06:33:00.362236 11545 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } attempt: 1
I20260810 06:33:00.363276 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.362916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40282)
0810 06:33:00.363096 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.363175 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260810 06:33:00.364220 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.363922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40290)
0810 06:33:00.364087 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.364142 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260810 06:33:00.364374 11545 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:43477: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
I20260810 06:33:00.405145 11417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } attempt: 2
I20260810 06:33:00.406111 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.405787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40300)
0810 06:33:00.405953 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.406022 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 06:33:00.406931 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.406703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40314)
0810 06:33:00.406817 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.406866 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 06:33:00.407064 11417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:43477: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
I20260810 06:33:00.432569 11545 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } attempt: 2
I20260810 06:33:00.433596 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.433175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40322)
0810 06:33:00.433368 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.433460 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260810 06:33:00.434377 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.434136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40326)
0810 06:33:00.434254 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.434312 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 06:33:00.434530 11545 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:43477: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
W20260810 06:33:00.446194 11559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:00.446509 11559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:00.446552 11559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:00.450875 11559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:33:00.450970 11559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:00.450999 11559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:00.451023 11559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:33:00.451051 11559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:33:00.456831 11559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:39925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:36153,127.21.195.253:39871,127.21.195.252:43477
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab
--principal=kudu/127.21.195.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.252:43477
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.195.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11559
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:00.458237 11559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:00.459411 11559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:00.468901 11567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:00.468901 11565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:00.468925 11572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:00.469056 11559 server_base.cc:1034] running on GCE node
I20260810 06:33:00.469907 11559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:00.471230 11559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:00.472399 11559 hybrid_clock.cc:648] HybridClock initialized: now 1786343580472376 us; error 44 us; skew 500 ppm
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343580, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:00.475510 11559 init.cc:377] Logged in from keytab as kudu/127.21.195.252@KRBTEST.COM (short username kudu)
I20260810 06:33:00.476620 11559 webserver.cc:460] Webserver started at http://127.21.195.252:32935/ using document root <none> and password file <none>
I20260810 06:33:00.477262 11559 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:00.477341 11559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:00.477629 11559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:00.480011 11559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/data/instance:
uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c"
format_stamp: "Formatted at 2026-08-10 06:33:00 on dist-test-slave-7lbf"
server_key: "ddf2030133c9222610f226c7040ac96d"
server_key_iv: "a8ac9b40ca53d8245a5dd6cb92038a40"
server_key_version: "encryptionkey@0"
I20260810 06:33:00.480649 11559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/wal/instance:
uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c"
format_stamp: "Formatted at 2026-08-10 06:33:00 on dist-test-slave-7lbf"
server_key: "ddf2030133c9222610f226c7040ac96d"
server_key_iv: "a8ac9b40ca53d8245a5dd6cb92038a40"
server_key_version: "encryptionkey@0"
I20260810 06:33:00.485014 11559 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:33:00.487959 11584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:00.489378 11559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:00.489554 11559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/wal
uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c"
format_stamp: "Formatted at 2026-08-10 06:33:00 on dist-test-slave-7lbf"
server_key: "ddf2030133c9222610f226c7040ac96d"
server_key_iv: "a8ac9b40ca53d8245a5dd6cb92038a40"
server_key_version: "encryptionkey@0"
I20260810 06:33:00.489691 11559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:00.506242 11417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } attempt: 3
I20260810 06:33:00.507210 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.506851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40342)
0810 06:33:00.507029 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.507106 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260810 06:33:00.507987 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.507719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40354)
0810 06:33:00.507852 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.507911 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 06:33:00.508121 11417 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:43477: Network error: Client connection negotiation failed: client connection to 127.21.195.252:43477: connect: Connection refused (error 111)
I20260810 06:33:00.509295 11559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:00.512730 11559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:00.512934 11559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:00.520172 11559 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.252:43477
I20260810 06:33:00.520452 11668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.252:43477 every 8 connection(s)
I20260810 06:33:00.521342 11559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
I20260810 06:33:00.524654 11671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:00.525683 11545 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } attempt: 3
I20260810 06:33:00.527169 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 11559
I20260810 06:33:00.527285 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786343407647307-22287-0/minicluster-data/master-2/wal/instance
I20260810 06:33:00.527587 22287 external_mini_cluster.cc:1428] Setting key f7d8292b19e3080c3ad80ced2e20e347
I20260810 06:33:00.531477 11671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343580, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343580, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:00.540632 11551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.526272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40364)
0810 06:33:00.526438 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.526456 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.526559 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.529848 (+ 3289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.529852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.530087 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.530228 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.530237 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.531967 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.531971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.532750 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.532766 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.533684 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.533689 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.533794 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.534366 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.534383 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.535980 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.538502 (+ 2522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.538505 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.538508 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.538728 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.539104 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.539108 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.539110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.539216 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.540016 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.540020 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.540147 (+ 127us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.540262 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.540423 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 06:33:00.541905 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.528291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40368 (local address 127.21.195.252:43477)
0810 06:33:00.528665 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.528673 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.528690 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:33:00.528893 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.528921 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.529440 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.529889 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.530905 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.531761 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.532661 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.533495 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.533682 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.536609 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.536613 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.536615 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.536642 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.538659 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.539121 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.539124 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.539126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.539213 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.539531 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.539535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.539536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.539880 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.540082 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.541611 (+ 1529us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.541771 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":304,"spinlock_wait_cycles":10368,"thread_start_us":143,"threads_started":1}
I20260810 06:33:00.541914 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.527007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40364 (local address 127.21.195.252:43477)
0810 06:33:00.527508 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.527530 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.527579 (+ 49us) server_negotiation.cc:407] Connection header received
0810 06:33:00.528893 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.528921 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.529440 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.529889 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.530511 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.531788 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.532881 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.533495 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.534051 (+ 556us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.536183 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.536190 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.536203 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.536236 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.538351 (+ 2115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.538852 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.538857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.538862 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.538988 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.539329 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.539332 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.539333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.539880 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.540017 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.540409 (+ 392us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.540698 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":618,"server-negotiator.queue_time_us":327,"spinlock_wait_cycles":20352,"thread_start_us":120,"threads_started":1}
I20260810 06:33:00.545359 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.533696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:36153 (local address 127.0.0.1:44726)
0810 06:33:00.534158 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.534220 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.534349 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.534690 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.534696 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.535180 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.535338 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.535346 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.536365 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.536369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.537310 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.537322 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.537897 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.537901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.538033 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.538915 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.538932 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.541085 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.543399 (+ 2314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.543406 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.543411 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.543626 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.544206 (+ 580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.544209 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.544210 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.544306 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.544817 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.544824 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.544950 (+ 126us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.545069 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.545225 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":135,"threads_started":1}
I20260810 06:33:00.545444 11422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.533738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.21.195.254:36153)
0810 06:33:00.533889 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.533893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.534292 (+ 399us) server_negotiation.cc:407] Connection header received
0810 06:33:00.534473 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.534476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.534533 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.534622 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.535499 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.536237 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.537495 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.537779 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.537873 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.541256 (+ 3383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.541260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.541263 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.541296 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.543294 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.543722 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.543726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.543728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.543841 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.544428 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.544432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.544441 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.544691 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.544795 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.545164 (+ 369us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.545289 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 06:33:00.547051 11545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407: Bootstrap starting.
I20260810 06:33:00.549661 11545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:00.550722 11545 log.cc:824] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:00.550822 11671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:33:00.554032 11545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407: No bootstrap required, opened a new log
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343580, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:33:00.558645 11545 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.558947 11545 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:00.559015 11545 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e7db46630f4bbd9e64c739cae8f407, State: Initialized, Role: FOLLOWER
I20260810 06:33:00.559547 11422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.549675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44742 (local address 127.21.195.254:36153)
0810 06:33:00.549838 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.549842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.549859 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:33:00.549908 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.549911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.549968 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.550070 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.550980 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.551633 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.552510 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.552832 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.552939 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.555828 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.555832 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.555836 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.555865 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.557488 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.557947 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.557951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.557953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.558042 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.558309 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.558312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.558314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.558507 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.558738 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.559229 (+ 491us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.559378 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:33:00.559541 11545 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.559778 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.551484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34490 (local address 127.21.195.253:39871)
0810 06:33:00.551623 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.551628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.551644 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:33:00.551683 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.551686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.551727 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.551793 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.552351 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.552882 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.553921 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.554224 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.554342 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.556274 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.556278 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.556280 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.556308 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.557879 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.558382 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.558386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.558388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.558487 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.558830 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.558833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.558835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.559098 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.559195 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.559534 (+ 339us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.559659 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:33:00.560312 11685 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.560567 11685 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:33:00.560842 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.551400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:39871 (local address 127.0.0.1:34490)
0810 06:33:00.551508 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.551524 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.551608 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.551828 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.551831 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.552061 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.552198 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.552207 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.553028 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.553032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.553784 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.553797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.554359 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.554363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.554465 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.554896 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.554909 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.556075 (+ 1166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.558013 (+ 1938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.558016 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.558018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.558270 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.558602 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.558605 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.558607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.558697 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.559242 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.559246 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.559346 (+ 100us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.560137 (+ 791us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.560304 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 06:33:00.561184 11545 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:33:00.562057 11671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343580, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
I20260810 06:33:00.565128 11427 master_runner.cc:186] Error getting master registration for 127.21.195.254:36153: OK, instance_id { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" instance_seqno: 1786343580031661 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:33:00.569142 11427 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:33:00.571923 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.562576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40382)
0810 06:33:00.562670 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.562682 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.562758 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.563147 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.563150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.563323 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.563419 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.563426 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.564441 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.564444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.565209 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.565218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.566193 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.566197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.566294 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.566829 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.566845 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.568286 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.570373 (+ 2087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.570376 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.570378 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.570618 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.570874 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.570876 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.570878 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.570955 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.571442 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.571444 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.571528 (+ 84us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.571617 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.571756 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 06:33:00.572027 11701 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:33:00.572101 11701 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:33:00.572410 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.561415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34502 (local address 127.21.195.253:39871)
0810 06:33:00.561580 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.561584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.561597 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:33:00.561632 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.561635 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.561677 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.561753 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.563014 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.563685 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.564766 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.565103 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.565190 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.568436 (+ 3246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.568440 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.568443 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.568469 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.569985 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.570514 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.570517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.570519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.570611 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.570933 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.570949 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.570950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.571185 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.572057 (+ 872us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.572138 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.572265 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:33:00.572731 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.562704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40382 (local address 127.21.195.252:43477)
0810 06:33:00.562850 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.562855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.562870 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:33:00.562906 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.562909 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.562954 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.563037 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.563565 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.564323 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.565332 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.566058 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.566165 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.568438 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.568442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.568444 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.568467 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.570245 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.570714 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.570717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.570719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.570793 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.571033 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.571036 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.571037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.571313 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.571410 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.572451 (+ 1041us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.572586 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:33:00.576155 11671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c: Bootstrap starting.
I20260810 06:33:00.576501 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:33:00.579387 11671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:00.580462 11671 log.cc:824] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:00.588212 11671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c: No bootstrap required, opened a new log
I20260810 06:33:00.591270 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.579022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40388 (local address 127.21.195.252:43477)
0810 06:33:00.579600 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.579604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.580125 (+ 521us) server_negotiation.cc:407] Connection header received
0810 06:33:00.580241 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.580245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.580305 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.580394 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.581559 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.582369 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.583745 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.584103 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.584204 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.587270 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.587274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.587277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.587306 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.588953 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.589432 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.589436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.589438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.589572 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.589864 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.589867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.589869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.590111 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.590229 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.590971 (+ 742us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.591097 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420}
I20260810 06:33:00.591338 11422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.579083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44750 (local address 127.21.195.254:36153)
0810 06:33:00.579217 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.579222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.580433 (+ 1211us) server_negotiation.cc:407] Connection header received
0810 06:33:00.580627 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.580630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.580687 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.580740 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.581573 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.582370 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.583746 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.584108 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.584204 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.586362 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.586367 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.586369 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.586404 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.588051 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.589662 (+ 1611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.589666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.589668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.589762 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.590066 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.590069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.590071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.590296 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.590424 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.591033 (+ 609us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.591166 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:33:00.593820 11671 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.594115 11541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.579784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34514 (local address 127.21.195.253:39871)
0810 06:33:00.579900 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.579904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.581774 (+ 1870us) server_negotiation.cc:407] Connection header received
0810 06:33:00.581964 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.581968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.582021 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.582074 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.583017 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.583799 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.584927 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.585227 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.585353 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.587017 (+ 1664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.587022 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.587025 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.587059 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.589483 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.592644 (+ 3161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.592648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.592650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.592751 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.593092 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.593095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.593097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.593335 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.593437 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.593827 (+ 390us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.593960 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 06:33:00.594149 11671 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:00.594204 11671 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2fcd70835d4cf1a2be45a63ab98d0c, State: Initialized, Role: FOLLOWER
I20260810 06:33:00.594764 11671 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.595351 11718 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.595559 11718 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:33:00.596307 11671 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: configured and running, proceeding with master startup.
W20260810 06:33:00.602859 11741 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:33:00.603039 11741 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:33:00.600907 11559 master_runner.cc:186] Error getting master registration for 127.21.195.254:36153: OK, instance_id { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" instance_seqno: 1786343580031661 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:33:00.604328 11559 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:33:00.672310 11417 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } attempt: 4
Aug 10 06:33:00 dist-test-slave-7lbf krb5kdc[11296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343579, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
I20260810 06:33:00.683115 11423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.673010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:43477 (local address 127.0.0.1:40400)
0810 06:33:00.673247 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:00.673263 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:00.673412 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:00.673761 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:00.673765 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:00.674007 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:00.674154 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.674162 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.675252 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.675256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.676128 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:00.676142 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.676770 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.676773 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:00.676871 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.677509 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:00.677550 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:00.679246 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:00.681341 (+ 2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.681345 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.681347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.681676 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.681985 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:00.681988 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:00.681990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:00.682094 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:00.682525 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:00.682528 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:00.682647 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 06:33:00.682759 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 06:33:00.682924 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260810 06:33:00.683162 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:00.673128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40400 (local address 127.21.195.252:43477)
0810 06:33:00.673264 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:00.673269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:00.673351 (+ 82us) server_negotiation.cc:407] Connection header received
0810 06:33:00.673552 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:00.673556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:00.673620 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:00.673729 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:00.674308 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.675085 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.676300 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:00.676630 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:00.677222 (+ 592us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:00.679427 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:00.679431 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:00.679434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:00.679468 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:00.681200 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.681779 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.681783 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.681785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.681888 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:00.682181 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:00.682184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:00.682186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:00.682429 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:00.682534 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:00.682822 (+ 288us) server_negotiation.cc:299] Negotiation successful
0810 06:33:00.682976 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:33:00.687477 11417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a: Bootstrap starting.
I20260810 06:33:00.690951 11417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:00.692078 11417 log.cc:824] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:00.695065 11417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a: No bootstrap required, opened a new log
I20260810 06:33:00.699780 11417 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.700133 11417 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:00.700217 11417 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddcb1f3cd00b4989a1e9a895335a523a, State: Initialized, Role: FOLLOWER
I20260810 06:33:00.700820 11417 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.701581 11745 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.701823 11745 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:33:00.702718 11417 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [sys.catalog]: configured and running, proceeding with master startup.
W20260810 06:33:00.709331 11763 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:33:00.709452 11763 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:33:00.714195 11317 master_runner.cc:263] No leader master found from master ddcb1f3cd00b4989a1e9a895335a523a
I20260810 06:33:00.714308 11317 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:33:00.724355 11718 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:00.724611 11718 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.725848 11718 leader_election.cc:288] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddcb1f3cd00b4989a1e9a895335a523a (127.21.195.254:36153), c8e7db46630f4bbd9e64c739cae8f407 (127.21.195.253:39871)
I20260810 06:33:00.727173 11382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" is_pre_election: true
I20260810 06:33:00.727635 11382 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2fcd70835d4cf1a2be45a63ab98d0c in term 0.
I20260810 06:33:00.728173 11497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e7db46630f4bbd9e64c739cae8f407" is_pre_election: true
I20260810 06:33:00.728523 11497 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2fcd70835d4cf1a2be45a63ab98d0c in term 0.
I20260810 06:33:00.729169 11586 leader_election.cc:302] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2fcd70835d4cf1a2be45a63ab98d0c, ddcb1f3cd00b4989a1e9a895335a523a; no voters:
I20260810 06:33:00.729887 11718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:33:00.730005 11718 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:33:00.730057 11718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:00.731485 11718 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.731876 11718 leader_election.cc:288] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [CANDIDATE]: Term 1 election: Requested vote from peers ddcb1f3cd00b4989a1e9a895335a523a (127.21.195.254:36153), c8e7db46630f4bbd9e64c739cae8f407 (127.21.195.253:39871)
I20260810 06:33:00.732596 11497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e7db46630f4bbd9e64c739cae8f407"
I20260810 06:33:00.732762 11497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:00.733664 11382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddcb1f3cd00b4989a1e9a895335a523a"
I20260810 06:33:00.733825 11382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:00.735198 11382 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2fcd70835d4cf1a2be45a63ab98d0c in term 1.
I20260810 06:33:00.735605 11586 leader_election.cc:302] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad2fcd70835d4cf1a2be45a63ab98d0c, ddcb1f3cd00b4989a1e9a895335a523a; no voters:
I20260810 06:33:00.736466 11497 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2fcd70835d4cf1a2be45a63ab98d0c in term 1.
I20260810 06:33:00.736984 11718 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:33:00.737236 11718 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [term 1 LEADER]: Becoming Leader. State: Replica: ad2fcd70835d4cf1a2be45a63ab98d0c, State: Running, Role: LEADER
I20260810 06:33:00.737665 11718 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } }
I20260810 06:33:00.739825 11718 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad2fcd70835d4cf1a2be45a63ab98d0c. Latest consensus state: current_term: 1 leader_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.739972 11718 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:00.740397 11769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:33:00.741362 11769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:33:00.748907 11497 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [term 1 FOLLOWER]: Refusing update from remote peer ad2fcd70835d4cf1a2be45a63ab98d0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:00.748872 11382 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [term 1 FOLLOWER]: Refusing update from remote peer ad2fcd70835d4cf1a2be45a63ab98d0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:00.749836 11718 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:00.750428 11767 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:00.755112 11685 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad2fcd70835d4cf1a2be45a63ab98d0c. Latest consensus state: current_term: 1 leader_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.755112 11745 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad2fcd70835d4cf1a2be45a63ab98d0c. Latest consensus state: current_term: 1 leader_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.755276 11745 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:33:00.755275 11685 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:33:00.758704 11767 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.758873 11767 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:00.760380 11745 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.760533 11745 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:33:00.761507 11772 mvcc.cc:205] Tried to move back new op lower bound from 7316863306739662848 to 7316863306705178624. Current Snapshot: MvccSnapshot[applied={T|T < 7316863306739662848}]
I20260810 06:33:00.762179 11718 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.762320 11718 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:00.763660 11771 mvcc.cc:205] Tried to move back new op lower bound from 7316863306739662848 to 7316863306705178624. Current Snapshot: MvccSnapshot[applied={T|T < 7316863306739662848}]
I20260810 06:33:00.764019 11685 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddcb1f3cd00b4989a1e9a895335a523a" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 36153 } } peers { permanent_uuid: "c8e7db46630f4bbd9e64c739cae8f407" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 39871 } } peers { permanent_uuid: "ad2fcd70835d4cf1a2be45a63ab98d0c" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 43477 } } }
I20260810 06:33:00.764144 11685 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:33:00.766261 11769 catalog_manager.cc:1347] Generated new cluster ID: 6d3037f92b3c4a8cb4fe3547016d29f5
I20260810 06:33:00.766347 11769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:33:00.812981 11769 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:33:00.814512 11769 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:33:00.830112 11769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad2fcd70835d4cf1a2be45a63ab98d0c: Generated new TSK 0
I20260810 06:33:00.831177 11769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:33:01.573693 11701 catalog_manager.cc:1259] Loaded cluster ID: 6d3037f92b3c4a8cb4fe3547016d29f5
I20260810 06:33:01.573789 11701 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407: loading cluster ID for follower catalog manager: success
I20260810 06:33:01.575563 11701 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407: acquiring CA information for follower catalog manager: success
I20260810 06:33:01.576954 11701 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c8e7db46630f4bbd9e64c739cae8f407: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:33:01.710935 11763 catalog_manager.cc:1259] Loaded cluster ID: 6d3037f92b3c4a8cb4fe3547016d29f5
I20260810 06:33:01.711040 11763 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a: loading cluster ID for follower catalog manager: success
I20260810 06:33:01.713022 11763 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a: acquiring CA information for follower catalog manager: success
I20260810 06:33:01.714445 11763 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ddcb1f3cd00b4989a1e9a895335a523a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:33:01.907929 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 11317
I20260810 06:33:01.920701 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 11427
I20260810 06:33:01.940904 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 11559
2026-08-10T06:33:01Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3422 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:33:02 dist-test-slave-7lbf krb5kdc[11794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:33:02 dist-test-slave-7lbf krb5kdc[11794](info): set up 2 sockets
Aug 10 06:33:02 dist-test-slave-7lbf krb5kdc[11794](info): commencing operation
krb5kdc: starting...
W20260810 06:33:03.118284 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:33:03 dist-test-slave-7lbf krb5kdc[11794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:33:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:33:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:33:03.251336 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44327
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:46305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:44327
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:03.390839 11818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:03.391175 11818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:03.391219 11818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:03.395519 11818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:33:03.395617 11818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:03.395637 11818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:03.395653 11818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:33:03.395675 11818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:33:03.401506 11818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:46305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:44327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:03.402809 11818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:03.403954 11818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:03.413487 11832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:03.413487 11828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:03.413487 11829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:03.413609 11818 server_base.cc:1034] running on GCE node
I20260810 06:33:03.414491 11818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:03.415764 11818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:03.416930 11818 hybrid_clock.cc:648] HybridClock initialized: now 1786343583416903 us; error 48 us; skew 500 ppm
Aug 10 06:33:03 dist-test-slave-7lbf krb5kdc[11794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343583, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:03.419965 11818 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:33:03.421021 11818 webserver.cc:460] Webserver started at http://127.21.195.254:43923/ using document root <none> and password file <none>
I20260810 06:33:03.421713 11818 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:03.421792 11818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:03.422048 11818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:03.424405 11818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "f4f4dd879a0940348cdd7afe63e78d82"
format_stamp: "Formatted at 2026-08-10 06:33:03 on dist-test-slave-7lbf"
server_key: "f9b8d0e5d88fece11907501bb56dcc30"
server_key_iv: "55b73f962a285ce52e1acd22e2cfab94"
server_key_version: "encryptionkey@0"
I20260810 06:33:03.425052 11818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "f4f4dd879a0940348cdd7afe63e78d82"
format_stamp: "Formatted at 2026-08-10 06:33:03 on dist-test-slave-7lbf"
server_key: "f9b8d0e5d88fece11907501bb56dcc30"
server_key_iv: "55b73f962a285ce52e1acd22e2cfab94"
server_key_version: "encryptionkey@0"
I20260810 06:33:03.429229 11818 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 06:33:03.431999 11842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:03.433310 11818 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260810 06:33:03.433437 11818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "f4f4dd879a0940348cdd7afe63e78d82"
format_stamp: "Formatted at 2026-08-10 06:33:03 on dist-test-slave-7lbf"
server_key: "f9b8d0e5d88fece11907501bb56dcc30"
server_key_iv: "55b73f962a285ce52e1acd22e2cfab94"
server_key_version: "encryptionkey@0"
I20260810 06:33:03.433626 11818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:03.450052 11818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:03.453771 11818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:03.454003 11818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:03.461494 11818 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:44327
I20260810 06:33:03.461506 11924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:44327 every 8 connection(s)
I20260810 06:33:03.462702 11818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:33:03.465886 11926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:03.472357 11926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82: Bootstrap starting.
I20260810 06:33:03.472579 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 11818
I20260810 06:33:03.472688 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:33:03.472924 22287 external_mini_cluster.cc:1428] Setting key d392facff2a5c6cb332d7a319f47e61a
I20260810 06:33:03.475224 11926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:03.476056 11926 log.cc:824] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:03.478462 11926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82: No bootstrap required, opened a new log
Aug 10 06:33:03 dist-test-slave-7lbf krb5kdc[11794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:03.483174 11926 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f4dd879a0940348cdd7afe63e78d82" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44327 } }
I20260810 06:33:03.483475 11926 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:03.483547 11926 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f4dd879a0940348cdd7afe63e78d82, State: Initialized, Role: FOLLOWER
I20260810 06:33:03.484077 11926 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f4dd879a0940348cdd7afe63e78d82" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44327 } }
I20260810 06:33:03.484244 11926 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:33:03.484354 11926 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:33:03.484488 11926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:03.485560 11926 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f4dd879a0940348cdd7afe63e78d82" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44327 } }
I20260810 06:33:03.485957 11926 leader_election.cc:302] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4f4dd879a0940348cdd7afe63e78d82; no voters:
I20260810 06:33:03.486377 11926 leader_election.cc:288] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:33:03.486500 11934 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:33:03.486717 11934 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [term 1 LEADER]: Becoming Leader. State: Replica: f4f4dd879a0940348cdd7afe63e78d82, State: Running, Role: LEADER
I20260810 06:33:03.487149 11934 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f4dd879a0940348cdd7afe63e78d82" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44327 } }
I20260810 06:33:03.487941 11926 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:33:03.488505 11934 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4f4dd879a0940348cdd7afe63e78d82. Latest consensus state: current_term: 1 leader_uuid: "f4f4dd879a0940348cdd7afe63e78d82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f4dd879a0940348cdd7afe63e78d82" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44327 } } }
I20260810 06:33:03.488719 11934 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:03.488962 11935 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4f4dd879a0940348cdd7afe63e78d82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f4dd879a0940348cdd7afe63e78d82" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44327 } } }
I20260810 06:33:03.489126 11935 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:03.489183 11948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:33:03.489347 11931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:03.474370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53590 (local address 127.21.195.254:44327)
0810 06:33:03.474817 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:03.474834 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:03.474874 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:33:03.475625 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:03.475646 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:03.476047 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:03.476371 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:03.477174 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:03.478266 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:03.479423 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:03.479933 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:03.480065 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:03.483089 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:03.483095 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:03.483113 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:03.483148 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:03.485188 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:03.485803 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:03.485809 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:03.485814 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:03.485968 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:03.486268 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:03.486271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:03.486272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:03.486915 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:03.487157 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:03.487870 (+ 713us) server_negotiation.cc:299] Negotiation successful
0810 06:33:03.488232 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":113,"threads_started":1}
I20260810 06:33:03.492902 11948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:33:03.493016 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:33:03.498899 11948 catalog_manager.cc:1347] Generated new cluster ID: 21b5b95e01bd4153859ff5180cde4ca2
I20260810 06:33:03.498994 11948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:33:03.508683 11948 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:33:03.510195 11948 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:33:03.524292 11948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4f4dd879a0940348cdd7afe63e78d82: Generated new TSK 0
I20260810 06:33:03.525377 11948 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:33:03.549418 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 11818
2026-08-10T06:33:03Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1613 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:33:03 dist-test-slave-7lbf krb5kdc[11974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:33:03 dist-test-slave-7lbf krb5kdc[11974](info): set up 2 sockets
Aug 10 06:33:03 dist-test-slave-7lbf krb5kdc[11974](info): commencing operation
krb5kdc: starting...
W20260810 06:33:04.756150 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:33:04 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:33:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:33:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:33:04.894564 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39725
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:39725
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:05.018157 11998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:05.018487 11998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:05.018530 11998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:05.022815 11998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:33:05.022895 11998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:05.022920 11998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:05.022938 11998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:33:05.022951 11998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:33:05.028726 11998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:39725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:05.030050 11998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:05.031250 11998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:05.040752 12006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:05.040784 12013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:05.040726 12007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:05.040938 11998 server_base.cc:1034] running on GCE node
I20260810 06:33:05.041697 11998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:05.042989 11998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:05.044155 11998 hybrid_clock.cc:648] HybridClock initialized: now 1786343585044128 us; error 46 us; skew 500 ppm
Aug 10 06:33:05 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:05.047169 11998 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:33:05.048208 11998 webserver.cc:460] Webserver started at http://127.21.195.254:34343/ using document root <none> and password file <none>
I20260810 06:33:05.048830 11998 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:05.048908 11998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:05.049129 11998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:05.051505 11998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "3ab3657c78504f7aada43f734a6b6559"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "0c0e4b1d67db6114b63fee9dd2769782"
server_key_iv: "3c1e2ab5d690793080e5a653dec6f95f"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.052111 11998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "3ab3657c78504f7aada43f734a6b6559"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "0c0e4b1d67db6114b63fee9dd2769782"
server_key_iv: "3c1e2ab5d690793080e5a653dec6f95f"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.056520 11998 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:33:05.059434 12022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.060878 11998 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:05.061028 11998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "3ab3657c78504f7aada43f734a6b6559"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "0c0e4b1d67db6114b63fee9dd2769782"
server_key_iv: "3c1e2ab5d690793080e5a653dec6f95f"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.061157 11998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:05.075444 11998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:05.079224 11998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:05.079445 11998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:05.087018 11998 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:39725
I20260810 06:33:05.087297 12103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:39725 every 8 connection(s)
I20260810 06:33:05.088152 11998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:33:05.091421 12105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:05.092990 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 11998
I20260810 06:33:05.093109 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:33:05.093384 22287 external_mini_cluster.cc:1428] Setting key 262461374df14b3e9c15c4b7f85cbda8
I20260810 06:33:05.098403 12105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Bootstrap starting.
I20260810 06:33:05.101308 12105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:05.102391 12105 log.cc:824] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:33:05 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:05.104770 12105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: No bootstrap required, opened a new log
I20260810 06:33:05.108618 12110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.094980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50700 (local address 127.21.195.254:39725)
0810 06:33:05.095438 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:05.095456 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:05.095496 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:33:05.096187 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:05.096206 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:05.096591 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:05.096916 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:05.097873 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.098920 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.100076 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.100577 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.100698 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.103708 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:05.103714 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:05.103732 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:05.103762 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:05.105574 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.106092 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.106097 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.106102 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.106235 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.106516 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.106518 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.106519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.106973 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:05.107131 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:05.107449 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 06:33:05.107753 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":125,"threads_started":1}
I20260810 06:33:05.109128 12105 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:05.109452 12105 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:05.109549 12105 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab3657c78504f7aada43f734a6b6559, State: Initialized, Role: FOLLOWER
I20260810 06:33:05.110080 12105 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:05.110234 12105 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:33:05.110301 12105 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:33:05.110407 12105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:05.111593 12105 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:05.111950 12105 leader_election.cc:302] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ab3657c78504f7aada43f734a6b6559; no voters:
I20260810 06:33:05.112275 12105 leader_election.cc:288] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:33:05.112382 12112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:33:05.112597 12112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 1 LEADER]: Becoming Leader. State: Replica: 3ab3657c78504f7aada43f734a6b6559, State: Running, Role: LEADER
I20260810 06:33:05.112978 12112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:05.113607 12105 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:33:05.114744 12115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ab3657c78504f7aada43f734a6b6559. Latest consensus state: current_term: 1 leader_uuid: "3ab3657c78504f7aada43f734a6b6559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } } }
I20260810 06:33:05.114890 12115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:05.115183 12114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ab3657c78504f7aada43f734a6b6559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } } }
I20260810 06:33:05.115320 12114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:05.115343 12124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:33:05.118585 12124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:33:05.125437 12124 catalog_manager.cc:1347] Generated new cluster ID: ba2b42779a504a24953377ce9a6b7a08
I20260810 06:33:05.125562 12124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:33:05.142956 12124 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:33:05.144074 12124 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:33:05.151777 12124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Generated new TSK 0
I20260810 06:33:05.152634 12124 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:33:05.187055 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39725
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:05.312659 12138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:05.313024 12138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:05.313089 12138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:05.317625 12138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:05.317713 12138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:05.317812 12138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:33:05.323685 12138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:05.325021 12138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:05.326272 12138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:05.337666 12144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:05.337790 12138 server_base.cc:1034] running on GCE node
W20260810 06:33:05.337666 12149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:05.337666 12147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:05.338519 12138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:05.339320 12138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:05.340521 12138 hybrid_clock.cc:648] HybridClock initialized: now 1786343585340492 us; error 46 us; skew 500 ppm
Aug 10 06:33:05 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:05.343740 12138 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:33:05.344831 12138 webserver.cc:460] Webserver started at http://127.21.195.193:37575/ using document root <none> and password file <none>
I20260810 06:33:05.345474 12138 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:05.345609 12138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:05.345873 12138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:05.348176 12138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "cb05900f64f846db8bb616805e33febc"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "11e90adbe9c809eb8434d0230006d246"
server_key_iv: "8556690993b67aaba4936141730ef5df"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.348799 12138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "cb05900f64f846db8bb616805e33febc"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "11e90adbe9c809eb8434d0230006d246"
server_key_iv: "8556690993b67aaba4936141730ef5df"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.353186 12138 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260810 06:33:05.356140 12161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.357914 12138 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 06:33:05.358063 12138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "cb05900f64f846db8bb616805e33febc"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "11e90adbe9c809eb8434d0230006d246"
server_key_iv: "8556690993b67aaba4936141730ef5df"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.358182 12138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:05.375387 12138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:05.379216 12138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:05.379437 12138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:05.380158 12138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:05.381155 12138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:05.381209 12138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.381266 12138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:05.381296 12138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.391671 12138 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:41279
I20260810 06:33:05.391695 12347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:41279 every 8 connection(s)
I20260810 06:33:05.392747 12138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:33:05.395852 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 12138
I20260810 06:33:05.396015 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:33:05.396333 22287 external_mini_cluster.cc:1428] Setting key 3bc320f1c3e223c1ae1efa092a2cf86c
Aug 10 06:33:05 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:33:05.409667 12110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.394873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:56941 (local address 127.21.195.254:39725)
0810 06:33:05.395004 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:05.395009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:05.396055 (+ 1046us) server_negotiation.cc:407] Connection header received
0810 06:33:05.397717 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:05.397721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:05.397773 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:05.397854 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:05.399289 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.400056 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.401958 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.402274 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.402378 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.405675 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:05.405679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:05.405681 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:05.405714 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:05.407114 (+ 1400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.407814 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.407817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.407818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.407895 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.408321 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.408324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.408325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.408530 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:05.408607 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:05.409281 (+ 674us) server_negotiation.cc:299] Negotiation successful
0810 06:33:05.409438 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:33:05.410677 12350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.395271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:56941)
0810 06:33:05.395865 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:05.395920 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:05.397462 (+ 1542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:05.398057 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:05.398067 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:05.398494 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:05.399089 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.399105 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.400231 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.400235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.401806 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.401821 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.402468 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.402473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.402709 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.403414 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:05.403441 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:05.405397 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:05.407255 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:05.407263 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:05.407286 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:05.407692 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:05.407986 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:05.407990 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:05.407992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:05.408212 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:05.408620 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:05.408626 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:05.408943 (+ 317us) client_negotiation.cc:769] Sending connection context
0810 06:33:05.409152 (+ 209us) client_negotiation.cc:240] Negotiation successful
0810 06:33:05.409582 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":137,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:33:05.412178 12348 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39725
I20260810 06:33:05.412452 12348 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:05.413028 12348 heartbeater.cc:511] Master 127.21.195.254:39725 requested a full tablet report, sending...
I20260810 06:33:05.414983 12048 ts_manager.cc:194] Registered new tserver with Master: cb05900f64f846db8bb616805e33febc (127.21.195.193:41279)
I20260810 06:33:05.416709 12048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:56941
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:33:05.428884 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39725
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:05.553777 12353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:05.554109 12353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:05.554157 12353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:05.558514 12353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:05.558599 12353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:05.558663 12353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:33:05.564453 12353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:05.565943 12353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:05.567224 12353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:05.578017 12366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:05.578063 12353 server_base.cc:1034] running on GCE node
W20260810 06:33:05.578003 12361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:05.577996 12363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:05.578636 12353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:05.579365 12353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:05.580534 12353 hybrid_clock.cc:648] HybridClock initialized: now 1786343585580503 us; error 48 us; skew 500 ppm
Aug 10 06:33:05 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:05.583582 12353 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:33:05.584642 12353 webserver.cc:460] Webserver started at http://127.21.195.194:38859/ using document root <none> and password file <none>
I20260810 06:33:05.585245 12353 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:05.585310 12353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:05.585502 12353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:05.587848 12353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "b83f16f1b0bd4f10a790c5daee36cb03"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "141f2eec34acaaa9b8dc51c3623240b5"
server_key_iv: "067f97f4d4aebe6b65c6bac23f531ca6"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.588429 12353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "b83f16f1b0bd4f10a790c5daee36cb03"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "141f2eec34acaaa9b8dc51c3623240b5"
server_key_iv: "067f97f4d4aebe6b65c6bac23f531ca6"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.592667 12353 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:33:05.595624 12381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.597148 12353 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:05.597278 12353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "b83f16f1b0bd4f10a790c5daee36cb03"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "141f2eec34acaaa9b8dc51c3623240b5"
server_key_iv: "067f97f4d4aebe6b65c6bac23f531ca6"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.597414 12353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:05.615600 12353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:05.619313 12353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:05.619500 12353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:05.620148 12353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:05.621073 12353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:05.621127 12353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.621169 12353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:05.621189 12353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.630722 12353 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:40807
I20260810 06:33:05.630772 12552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:40807 every 8 connection(s)
I20260810 06:33:05.631764 12353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:33:05.637856 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 12353
I20260810 06:33:05.637970 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:33:05.638227 22287 external_mini_cluster.cc:1428] Setting key 3e3504c61e86808392f67be948186a9f
Aug 10 06:33:05 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:05.647888 12110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.633891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:58235 (local address 127.21.195.254:39725)
0810 06:33:05.634067 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:05.634073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:05.635130 (+ 1057us) server_negotiation.cc:407] Connection header received
0810 06:33:05.636557 (+ 1427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:05.636561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:05.636618 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:05.636699 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:05.638286 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.638955 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.640478 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.640719 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.640808 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.644003 (+ 3195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:05.644006 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:05.644008 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:05.644038 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:05.645478 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.646140 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.646144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.646145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.646237 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.646606 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.646610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.646612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.646836 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:05.646949 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:05.647546 (+ 597us) server_negotiation.cc:299] Negotiation successful
0810 06:33:05.647707 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 06:33:05.648845 12555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.634379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:58235)
0810 06:33:05.634956 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:05.635007 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:05.636316 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:05.636915 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:05.636924 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:05.637358 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:05.638102 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.638124 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.639118 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.639122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.640322 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.640338 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.640893 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.640897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.641107 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.641865 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:05.641890 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:05.643745 (+ 1855us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:05.645670 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:05.645678 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:05.645700 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:05.646030 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:05.646330 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:05.646333 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:05.646335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:05.646509 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:05.646957 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:05.646966 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:05.647272 (+ 306us) client_negotiation.cc:769] Sending connection context
0810 06:33:05.647476 (+ 204us) client_negotiation.cc:240] Negotiation successful
0810 06:33:05.647874 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":119,"threads_started":1}
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:33:05.650254 12553 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39725
I20260810 06:33:05.650573 12553 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:05.651252 12553 heartbeater.cc:511] Master 127.21.195.254:39725 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:33:05.652581 12048 ts_manager.cc:194] Registered new tserver with Master: b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807)
I20260810 06:33:05.653199 12048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:58235
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:33:05.668853 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39725
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:05.794225 12560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:05.794586 12560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:05.794633 12560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:05.798988 12560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:05.799077 12560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:05.799141 12560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:33:05.804986 12560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:05.806344 12560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:05.807546 12560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:33:05.818976 12560 server_base.cc:1034] running on GCE node
W20260810 06:33:05.818919 12570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:05.818919 12576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:05.818933 12571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:05.819628 12560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:05.820344 12560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:05.821501 12560 hybrid_clock.cc:648] HybridClock initialized: now 1786343585821469 us; error 49 us; skew 500 ppm
Aug 10 06:33:05 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:05.824517 12560 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:33:05.825563 12560 webserver.cc:460] Webserver started at http://127.21.195.195:44505/ using document root <none> and password file <none>
I20260810 06:33:05.826198 12560 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:05.826267 12560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:05.826507 12560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:05.828827 12560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "2a2c792750e843e288dcc1af32f44306"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "ff0230170b3697605f0355e4716d28e6"
server_key_iv: "eb2730cc49c86fda842c5a02c595f638"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.829459 12560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "2a2c792750e843e288dcc1af32f44306"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "ff0230170b3697605f0355e4716d28e6"
server_key_iv: "eb2730cc49c86fda842c5a02c595f638"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.833930 12560 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:33:05.836782 12589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.838338 12560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:05.838485 12560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "2a2c792750e843e288dcc1af32f44306"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "ff0230170b3697605f0355e4716d28e6"
server_key_iv: "eb2730cc49c86fda842c5a02c595f638"
server_key_version: "encryptionkey@0"
I20260810 06:33:05.838613 12560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:05.852864 12560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:05.856559 12560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:05.856772 12560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:05.857543 12560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:05.858517 12560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:05.858582 12560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.858639 12560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:05.858668 12560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:05.869031 12560 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:40101
I20260810 06:33:05.869072 12789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:40101 every 8 connection(s)
I20260810 06:33:05.870153 12560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:33:05.877730 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 12560
I20260810 06:33:05.877858 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:33:05.878134 22287 external_mini_cluster.cc:1428] Setting key d5281a3d211cbd4a75297fce5b4702cc
Aug 10 06:33:05 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:05.885890 12110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.872377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:59101 (local address 127.21.195.254:39725)
0810 06:33:05.872551 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:05.872556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:05.873694 (+ 1138us) server_negotiation.cc:407] Connection header received
0810 06:33:05.875138 (+ 1444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:05.875142 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:05.875198 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:05.875276 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:05.876627 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.877303 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.878754 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.879050 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.879155 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.882041 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:05.882044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:05.882046 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:05.882077 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:05.883550 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.884109 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.884112 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.884114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.884206 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.884651 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.884655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.884656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.884880 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:05.884964 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:05.885605 (+ 641us) server_negotiation.cc:299] Negotiation successful
0810 06:33:05.885732 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 06:33:05.886783 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.872839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:59101)
0810 06:33:05.873489 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:05.873572 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:05.874892 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:05.875459 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:05.875467 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:05.875882 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:05.876436 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.876452 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.877473 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.877476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.878623 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.878635 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.879219 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.879223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.879405 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.880105 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:05.880129 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:05.881832 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:05.883666 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:05.883672 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:05.883689 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:05.883978 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:05.884322 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:05.884325 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:05.884327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:05.884505 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:05.884996 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:05.885003 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:05.885293 (+ 290us) client_negotiation.cc:769] Sending connection context
0810 06:33:05.885472 (+ 179us) client_negotiation.cc:240] Negotiation successful
0810 06:33:05.885842 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":148,"threads_started":1}
I20260810 06:33:05.888190 12790 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39725
I20260810 06:33:05.888480 12790 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:05.889053 12790 heartbeater.cc:511] Master 127.21.195.254:39725 requested a full tablet report, sending...
I20260810 06:33:05.890288 12048 ts_manager.cc:194] Registered new tserver with Master: 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101)
I20260810 06:33:05.891007 12048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:59101
I20260810 06:33:05.892621 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:33:05.902383 12110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.894844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50710 (local address 127.21.195.254:39725)
0810 06:33:05.894988 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:05.894993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:05.895192 (+ 199us) server_negotiation.cc:407] Connection header received
0810 06:33:05.895289 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:05.895291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:05.895334 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:05.895407 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:05.896096 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.896621 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.897397 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.897643 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.897718 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.899089 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:05.899092 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:05.899095 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:05.899120 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:05.900579 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.901040 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.901042 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.901043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.901137 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:05.901438 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:05.901440 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:05.901441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:05.901738 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:05.901853 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:05.902068 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 06:33:05.902191 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:33:05.905756 12048 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50710:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:33:05.908986 12048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:33:05.925470 12806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.919019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44980 (local address 127.21.195.195:40101)
0810 06:33:05.920045 (+ 1026us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:05.920058 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:05.920732 (+ 674us) server_negotiation.cc:407] Connection header received
0810 06:33:05.920824 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:05.920831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:05.921023 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:05.921165 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:05.921424 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.922254 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.923872 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.924739 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.924865 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.925027 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:05.925185 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 06:33:05.925289 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":915,"thread_start_us":182,"threads_started":1}
I20260810 06:33:05.925458 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.918881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:40101 (local address 127.0.0.1:44980)
0810 06:33:05.920538 (+ 1657us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:05.920550 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:05.920631 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:05.921164 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:05.921168 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:05.921185 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:05.921306 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.921313 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.922386 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.922390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.923715 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.923728 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.924871 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.924875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.924989 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.925027 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 06:33:05.925143 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 06:33:05.925289 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1598,"mutex_wait_us":838,"thread_start_us":126,"threads_started":1}
I20260810 06:33:05.925954 12807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.918881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:40807 (local address 127.0.0.1:57482)
0810 06:33:05.919517 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:05.919578 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:05.919726 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:05.920972 (+ 1246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:05.920979 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:05.921017 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:05.921242 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.921251 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.922894 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.922897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.924121 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.924131 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.925444 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.925448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.925611 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.925646 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 06:33:05.925718 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 06:33:05.925796 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":259,"spinlock_wait_cycles":6912,"thread_start_us":129,"threads_started":1}
I20260810 06:33:05.926041 12809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.919607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35790 (local address 127.21.195.193:41279)
0810 06:33:05.920011 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:05.920019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:05.920356 (+ 337us) server_negotiation.cc:407] Connection header received
0810 06:33:05.920512 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:05.920518 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:05.920698 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:05.920825 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:05.921397 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.922729 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.924351 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.925119 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.925242 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.925376 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:05.925798 (+ 422us) server_negotiation.cc:299] Negotiation successful
0810 06:33:05.925912 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":80,"threads_started":1}
I20260810 06:33:05.926442 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.919090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41279 (local address 127.0.0.1:35790)
0810 06:33:05.920241 (+ 1151us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:05.920252 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:05.920355 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:05.920972 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:05.920979 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:05.921015 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:05.921249 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.921256 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.922872 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.922876 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.924143 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:05.924155 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.925444 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.925448 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:05.925646 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.925664 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 06:33:05.926224 (+ 560us) client_negotiation.cc:240] Negotiation successful
0810 06:33:05.926298 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1095,"mutex_wait_us":142,"spinlock_wait_cycles":6144,"thread_start_us":120,"threads_started":1}
I20260810 06:33:05.926622 12816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:05.919813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57482 (local address 127.21.195.194:40807)
0810 06:33:05.920194 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:05.920205 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:05.920230 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:33:05.920309 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:05.920316 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:05.920554 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:05.920728 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:05.921387 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.922729 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.924260 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:05.925119 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:05.925242 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:05.925376 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:05.926155 (+ 779us) server_negotiation.cc:299] Negotiation successful
0810 06:33:05.926479 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":110,"threads_started":1}
I20260810 06:33:05.929350 12674 tablet_service.cc:1467] Processing CreateTablet for tablet 726fb590e2ff4327b56966806586d703 (DEFAULT_TABLE table=test-table [id=84cb4e280fc04b3da35d4d573d916ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:05.929771 12214 tablet_service.cc:1467] Processing CreateTablet for tablet 726fb590e2ff4327b56966806586d703 (DEFAULT_TABLE table=test-table [id=84cb4e280fc04b3da35d4d573d916ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:05.930781 12674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726fb590e2ff4327b56966806586d703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:05.930774 12214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726fb590e2ff4327b56966806586d703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:05.936122 12456 tablet_service.cc:1467] Processing CreateTablet for tablet 726fb590e2ff4327b56966806586d703 (DEFAULT_TABLE table=test-table [id=84cb4e280fc04b3da35d4d573d916ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:05.937245 12456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726fb590e2ff4327b56966806586d703. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:05.940269 12817 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Bootstrap starting.
I20260810 06:33:05.941941 12818 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Bootstrap starting.
I20260810 06:33:05.943046 12817 tablet_bootstrap.cc:654] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:05.943989 12818 tablet_bootstrap.cc:654] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:05.944046 12817 log.cc:824] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:05.945314 12818 log.cc:824] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:05.946345 12822 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Bootstrap starting.
I20260810 06:33:05.946516 12817 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: No bootstrap required, opened a new log
I20260810 06:33:05.946734 12817 ts_tablet_manager.cc:1397] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 06:33:05.947371 12818 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: No bootstrap required, opened a new log
I20260810 06:33:05.947575 12818 ts_tablet_manager.cc:1397] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:33:05.949216 12822 tablet_bootstrap.cc:654] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:05.950212 12822 log.cc:824] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:05.950747 12818 raft_consensus.cc:348] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:05.951088 12818 raft_consensus.cc:374] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:05.951151 12818 raft_consensus.cc:729] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a2c792750e843e288dcc1af32f44306, State: Initialized, Role: FOLLOWER
I20260810 06:33:05.951508 12817 raft_consensus.cc:348] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:05.951632 12818 consensus_queue.cc:260] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:05.951786 12817 raft_consensus.cc:374] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:05.951841 12817 raft_consensus.cc:729] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb05900f64f846db8bb616805e33febc, State: Initialized, Role: FOLLOWER
I20260810 06:33:05.952353 12817 consensus_queue.cc:260] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:05.952759 12818 ts_tablet_manager.cc:1428] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 06:33:05.953075 12822 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: No bootstrap required, opened a new log
I20260810 06:33:05.953301 12790 heartbeater.cc:503] Master 127.21.195.254:39725 was elected leader, sending a full tablet report...
I20260810 06:33:05.953438 12817 ts_tablet_manager.cc:1428] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 06:33:05.953639 12348 heartbeater.cc:503] Master 127.21.195.254:39725 was elected leader, sending a full tablet report...
I20260810 06:33:05.953864 12822 ts_tablet_manager.cc:1397] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260810 06:33:05.957720 12822 raft_consensus.cc:348] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:05.957996 12822 raft_consensus.cc:374] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:05.958065 12822 raft_consensus.cc:729] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83f16f1b0bd4f10a790c5daee36cb03, State: Initialized, Role: FOLLOWER
I20260810 06:33:05.958536 12822 consensus_queue.cc:260] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:05.959249 12553 heartbeater.cc:503] Master 127.21.195.254:39725 was elected leader, sending a full tablet report...
I20260810 06:33:05.959479 12822 ts_tablet_manager.cc:1428] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:33:06.059592 12826 raft_consensus.cc:482] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:06.059872 12826 raft_consensus.cc:504] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:06.061249 12826 leader_election.cc:288] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), cb05900f64f846db8bb616805e33febc (127.21.195.193:41279)
I20260810 06:33:06.066283 12809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.061759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:53435 (local address 127.21.195.193:41279)
0810 06:33:06.061929 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:06.061934 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:06.062278 (+ 344us) server_negotiation.cc:407] Connection header received
0810 06:33:06.062477 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:06.062480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:06.062535 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:06.062616 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:06.062860 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.063542 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.064925 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.065613 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.065839 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.065890 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:06.066054 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 06:33:06.066141 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260810 06:33:06.066283 12816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.061823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:35587 (local address 127.21.195.194:40807)
0810 06:33:06.061955 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:06.061960 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:06.061974 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:33:06.062025 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:06.062027 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:06.062081 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:06.062165 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:06.062493 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.063267 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.064767 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.065505 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.065672 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.065736 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:06.066063 (+ 327us) server_negotiation.cc:299] Negotiation successful
0810 06:33:06.066147 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:33:06.066322 12792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.061551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:40807 (local address 127.21.195.195:35587)
0810 06:33:06.061700 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:06.061716 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:06.061836 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:06.062202 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:06.062206 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:06.062232 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:06.062370 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.062377 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.063378 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.063381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.064615 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.064627 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.065652 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.065655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.065911 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.065944 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 06:33:06.066026 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 06:33:06.066130 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":7}
I20260810 06:33:06.066331 12831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.061608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41279 (local address 127.21.195.195:53435)
0810 06:33:06.062180 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:06.062193 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:06.062341 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:06.062639 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:06.062641 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:06.062657 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:06.062751 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.062756 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.063656 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.063660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.064776 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.064783 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.065838 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.065841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.065930 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.065946 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 06:33:06.066026 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 06:33:06.066130 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":19,"thread_start_us":168,"threads_started":1}
I20260810 06:33:06.067195 12490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726fb590e2ff4327b56966806586d703" candidate_uuid: "2a2c792750e843e288dcc1af32f44306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" is_pre_election: true
I20260810 06:33:06.067363 12278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726fb590e2ff4327b56966806586d703" candidate_uuid: "2a2c792750e843e288dcc1af32f44306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb05900f64f846db8bb616805e33febc" is_pre_election: true
I20260810 06:33:06.067549 12490 raft_consensus.cc:2454] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a2c792750e843e288dcc1af32f44306 in term 0.
I20260810 06:33:06.067689 12278 raft_consensus.cc:2454] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a2c792750e843e288dcc1af32f44306 in term 0.
I20260810 06:33:06.068166 12591 leader_election.cc:302] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a2c792750e843e288dcc1af32f44306, cb05900f64f846db8bb616805e33febc; no voters:
I20260810 06:33:06.068455 12826 raft_consensus.cc:2781] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:33:06.068547 12826 raft_consensus.cc:482] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:33:06.068596 12826 raft_consensus.cc:3037] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:06.069742 12826 raft_consensus.cc:504] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:06.070103 12826 leader_election.cc:288] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [CANDIDATE]: Term 1 election: Requested vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), cb05900f64f846db8bb616805e33febc (127.21.195.193:41279)
I20260810 06:33:06.070525 12278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726fb590e2ff4327b56966806586d703" candidate_uuid: "2a2c792750e843e288dcc1af32f44306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb05900f64f846db8bb616805e33febc"
I20260810 06:33:06.070655 12278 raft_consensus.cc:3037] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:06.071789 12278 raft_consensus.cc:2454] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a2c792750e843e288dcc1af32f44306 in term 1.
I20260810 06:33:06.072098 12591 leader_election.cc:302] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a2c792750e843e288dcc1af32f44306, cb05900f64f846db8bb616805e33febc; no voters:
I20260810 06:33:06.072068 12490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726fb590e2ff4327b56966806586d703" candidate_uuid: "2a2c792750e843e288dcc1af32f44306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83f16f1b0bd4f10a790c5daee36cb03"
I20260810 06:33:06.072220 12490 raft_consensus.cc:3037] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:06.072291 12826 raft_consensus.cc:2781] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:33:06.072554 12826 raft_consensus.cc:686] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 1 LEADER]: Becoming Leader. State: Replica: 2a2c792750e843e288dcc1af32f44306, State: Running, Role: LEADER
I20260810 06:33:06.072930 12826 consensus_queue.cc:237] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:06.073494 12490 raft_consensus.cc:2454] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a2c792750e843e288dcc1af32f44306 in term 1.
I20260810 06:33:06.076659 12048 catalog_manager.cc:5495] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a2c792750e843e288dcc1af32f44306 (127.21.195.195). New cstate: current_term: 1 leader_uuid: "2a2c792750e843e288dcc1af32f44306" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } health_report { overall_health: UNKNOWN } } }
W20260810 06:33:06.121330 12791 tablet.cc:2369] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:33:06.121596 12806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.117712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44992 (local address 127.21.195.195:40101)
0810 06:33:06.117842 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:06.117846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:06.117861 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:33:06.117989 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:06.117992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:06.118056 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:06.118149 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:33:06.118446 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.118974 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.119860 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.120115 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.120206 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.120533 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:33:06.121104 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:33:06.121243 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:06.121317 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 06:33:06.121395 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:33:06.128458 12490 raft_consensus.cc:1261] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 1 FOLLOWER]: Refusing update from remote peer 2a2c792750e843e288dcc1af32f44306: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:06.128458 12278 raft_consensus.cc:1261] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Refusing update from remote peer 2a2c792750e843e288dcc1af32f44306: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:06.129261 12826 consensus_queue.cc:1035] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:06.129482 12832 consensus_queue.cc:1035] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 06:33:06.132951 12554 tablet.cc:2369] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:33:06.139035 12839 mvcc.cc:205] Tried to move back new op lower bound from 7316863328773332992 to 7316863328558047232. Current Snapshot: MvccSnapshot[applied={T|T < 7316863328773332992}]
I20260810 06:33:06.148509 12048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:33:06.148749 12048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:33:06.151678 12048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Sending DeleteTablet for 3 replicas of tablet 726fb590e2ff4327b56966806586d703
I20260810 06:33:06.152592 12674 tablet_service.cc:1514] Processing DeleteTablet for tablet 726fb590e2ff4327b56966806586d703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:06 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:44980
I20260810 06:33:06.152607 12456 tablet_service.cc:1514] Processing DeleteTablet for tablet 726fb590e2ff4327b56966806586d703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:06 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:57482
I20260810 06:33:06.152725 12214 tablet_service.cc:1514] Processing DeleteTablet for tablet 726fb590e2ff4327b56966806586d703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:06 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:35790
I20260810 06:33:06.153020 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 12138
I20260810 06:33:06.153192 12855 tablet_replica.cc:330] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: stopping tablet replica
I20260810 06:33:06.155926 12855 raft_consensus.cc:2229] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:33:06.156401 12855 raft_consensus.cc:2258] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:06.163280 12855 ts_tablet_manager.cc:1905] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:06.167002 12855 ts_tablet_manager.cc:1918] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:06.167143 12855 log.cc:1196] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/726fb590e2ff4327b56966806586d703
I20260810 06:33:06.167467 12855 ts_tablet_manager.cc:1939] T 726fb590e2ff4327b56966806586d703 P b83f16f1b0bd4f10a790c5daee36cb03: Deleting consensus metadata
I20260810 06:33:06.169054 12023 catalog_manager.cc:4841] TS b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807): tablet 726fb590e2ff4327b56966806586d703 (table test-table [id=84cb4e280fc04b3da35d4d573d916ac5]) successfully deleted
I20260810 06:33:06.169616 12859 tablet_replica.cc:330] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: stopping tablet replica
I20260810 06:33:06.170022 12859 raft_consensus.cc:2229] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:33:06.170547 12859 raft_consensus.cc:2258] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:06.177084 12859 ts_tablet_manager.cc:1905] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:06.179766 12859 ts_tablet_manager.cc:1918] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:06.179891 12859 log.cc:1196] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/726fb590e2ff4327b56966806586d703
I20260810 06:33:06.180198 12859 ts_tablet_manager.cc:1939] T 726fb590e2ff4327b56966806586d703 P 2a2c792750e843e288dcc1af32f44306: Deleting consensus metadata
I20260810 06:33:06.181581 12030 catalog_manager.cc:4841] TS 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101): tablet 726fb590e2ff4327b56966806586d703 (table test-table [id=84cb4e280fc04b3da35d4d573d916ac5]) successfully deleted
W20260810 06:33:06.183833 12024 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:41279 (error 108)
I20260810 06:33:06.184535 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 12353
I20260810 06:33:06.185041 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.184694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41279 (local address 127.0.0.1:35796)
0810 06:33:06.184884 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:06.184948 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:41279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260810 06:33:06.191434 12024 catalog_manager.cc:4584] TS cb05900f64f846db8bb616805e33febc (127.21.195.193:41279): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 726fb590e2ff4327b56966806586d703: Network error: Client connection negotiation failed: client connection to 127.21.195.193:41279: connect: Connection refused (error 111)
I20260810 06:33:06.221810 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 12560
I20260810 06:33:06.241858 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 11998
I20260810 06:33:06.264575 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39725
--webserver_interface=127.21.195.254
--webserver_port=34343
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:39725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:06.388244 12865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:06.388707 12865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:06.388788 12865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:06.393431 12865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:33:06.393543 12865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:06.393579 12865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:06.393602 12865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:33:06.393630 12865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:33:06.399523 12865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:39725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=34343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:06.400739 12865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:06.401994 12865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:06.417729 12879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:06.417778 12865 server_base.cc:1034] running on GCE node
W20260810 06:33:06.417708 12878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:06.417708 12882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:06.418778 12865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:06.420197 12865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:06.421386 12865 hybrid_clock.cc:648] HybridClock initialized: now 1786343586421350 us; error 53 us; skew 500 ppm
Aug 10 06:33:06 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343586, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:06.424656 12865 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:33:06.425781 12865 webserver.cc:460] Webserver started at http://127.21.195.254:34343/ using document root <none> and password file <none>
I20260810 06:33:06.426429 12865 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:06.426522 12865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:06.430962 12865 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260810 06:33:06.433353 12891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:06.434813 12865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 06:33:06.434958 12865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "3ab3657c78504f7aada43f734a6b6559"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "0c0e4b1d67db6114b63fee9dd2769782"
server_key_iv: "3c1e2ab5d690793080e5a653dec6f95f"
server_key_version: "encryptionkey@0"
I20260810 06:33:06.435649 12865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:06.448586 12865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:06.451916 12865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:06.452136 12865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:06.459928 12865 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:39725
I20260810 06:33:06.460222 12976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:39725 every 8 connection(s)
I20260810 06:33:06.461220 12865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:33:06.462702 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 12865
I20260810 06:33:06.463125 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:41279
--local_ip_for_outbound_sockets=127.21.195.193
--tserver_master_addrs=127.21.195.254:39725
--webserver_port=37575
--webserver_interface=127.21.195.193
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:06.466383 12979 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:33:06.468391 12979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Bootstrap starting.
I20260810 06:33:06.486258 12979 log.cc:824] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:06.496449 12979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:33:06.496856 12979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Bootstrap complete.
I20260810 06:33:06.501097 12979 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:06.501590 12979 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab3657c78504f7aada43f734a6b6559, State: Initialized, Role: FOLLOWER
I20260810 06:33:06.502159 12979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:06.502303 12979 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:33:06.502384 12979 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:33:06.502501 12979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:33:06.504631 12979 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:06.505002 12979 leader_election.cc:302] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ab3657c78504f7aada43f734a6b6559; no voters:
I20260810 06:33:06.505344 12979 leader_election.cc:288] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 06:33:06.505471 12984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:33:06.505717 12984 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 2 LEADER]: Becoming Leader. State: Replica: 3ab3657c78504f7aada43f734a6b6559, State: Running, Role: LEADER
I20260810 06:33:06.506057 12984 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:06.506824 12979 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:33:06.507616 12986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3ab3657c78504f7aada43f734a6b6559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } } }
I20260810 06:33:06.507972 12986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:06.507870 12984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ab3657c78504f7aada43f734a6b6559. Latest consensus state: current_term: 2 leader_uuid: "3ab3657c78504f7aada43f734a6b6559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } } }
I20260810 06:33:06.508462 12984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:06.512902 13011 catalog_manager.cc:1259] Loaded cluster ID: ba2b42779a504a24953377ce9a6b7a08
I20260810 06:33:06.512986 13011 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: loading cluster ID for follower catalog manager: success
W20260810 06:33:06.514143 13011 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260810 06:33:06.514226 13011 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260810 06:33:06.514310 13001 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:33:06.516881 13001 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:33:06.517395 13001 catalog_manager.cc:1259] Loaded cluster ID: ba2b42779a504a24953377ce9a6b7a08
I20260810 06:33:06.517455 13001 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:33:06.518584 13001 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 06:33:06.522881 13001 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 06:33:06.529058 13001 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:33:06.530062 13001 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Loaded TSK: 0
I20260810 06:33:06.531483 13001 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:33:06.594558 12982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:06.594853 12982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:06.594900 12982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:06.599090 12982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:06.599171 12982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:06.599233 12982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:33:06.604871 12982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:41279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=37575
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:06.606189 12982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:06.607402 12982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:06.620054 13022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:06.620049 13028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:06.620048 13020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:06.620591 12982 server_base.cc:1034] running on GCE node
I20260810 06:33:06.621026 12982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:06.621816 12982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:06.623034 12982 hybrid_clock.cc:648] HybridClock initialized: now 1786343586622989 us; error 60 us; skew 500 ppm
Aug 10 06:33:06 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343586, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:06.626243 12982 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:33:06.627382 12982 webserver.cc:460] Webserver started at http://127.21.195.193:37575/ using document root <none> and password file <none>
I20260810 06:33:06.628038 12982 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:06.628140 12982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:06.632666 12982 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:06.635243 13041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:06.636720 12982 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:33:06.636859 12982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "cb05900f64f846db8bb616805e33febc"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "11e90adbe9c809eb8434d0230006d246"
server_key_iv: "8556690993b67aaba4936141730ef5df"
server_key_version: "encryptionkey@0"
I20260810 06:33:06.637482 12982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:06.651911 12982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:06.655563 12982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:06.655776 12982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:06.656500 12982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:06.657742 13054 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 06:33:06.662601 12982 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 06:33:06.662689 12982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260810 06:33:06.662755 12982 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 06:33:06.664752 12982 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 06:33:06.664809 12982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 06:33:06.665132 13054 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Bootstrap starting.
I20260810 06:33:06.675535 12982 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:41279
I20260810 06:33:06.675652 13221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:41279 every 8 connection(s)
I20260810 06:33:06.676707 12982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:33:06.681797 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 12982
I20260810 06:33:06.682313 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:40807
--local_ip_for_outbound_sockets=127.21.195.194
--tserver_master_addrs=127.21.195.254:39725
--webserver_port=38859
--webserver_interface=127.21.195.194
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:06.685065 13054 log.cc:824] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:33:06 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343586, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:06.694173 13054 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:33:06.694605 13054 tablet_bootstrap.cc:492] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Bootstrap complete.
I20260810 06:33:06.695847 13054 ts_tablet_manager.cc:1397] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Time spent bootstrapping tablet: real 0.031s user 0.024s sys 0.004s
I20260810 06:33:06.698738 13225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.679018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:58275)
0810 06:33:06.679749 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:06.679826 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:06.681048 (+ 1222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:06.682910 (+ 1862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:06.682921 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:06.683492 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:06.684196 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.684220 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.686240 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.686243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.687591 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.687603 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.688757 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.688761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.688972 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.689735 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:06.689757 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:06.691813 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:06.694748 (+ 2935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:06.694755 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:06.694772 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:06.695149 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:06.695637 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:06.695640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:06.695642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:06.695840 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:06.696684 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:06.696692 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:06.697028 (+ 336us) client_negotiation.cc:769] Sending connection context
0810 06:33:06.697244 (+ 216us) client_negotiation.cc:240] Negotiation successful
0810 06:33:06.697664 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":153,"threads_started":1}
I20260810 06:33:06.698758 13224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.679041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:58275 (local address 127.21.195.254:39725)
0810 06:33:06.679502 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:06.679525 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:06.680007 (+ 482us) server_negotiation.cc:407] Connection header received
0810 06:33:06.681633 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:06.681652 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:06.682147 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:06.682599 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:06.684440 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.686036 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.687765 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.688576 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.688775 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.692106 (+ 3331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:06.692114 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:06.692137 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:06.692189 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:06.694538 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:06.695304 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:06.695313 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:06.695320 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:06.695519 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:06.695951 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:06.695954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:06.695956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:06.696529 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:06.696664 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:06.697389 (+ 725us) server_negotiation.cc:299] Negotiation successful
0810 06:33:06.697880 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":147,"threads_started":1}
I20260810 06:33:06.699033 13054 raft_consensus.cc:348] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:06.699594 13054 raft_consensus.cc:729] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb05900f64f846db8bb616805e33febc, State: Initialized, Role: FOLLOWER
I20260810 06:33:06.700181 13054 consensus_queue.cc:260] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:06.703228 13054 ts_tablet_manager.cc:1428] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 06:33:06.703791 13222 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39725
I20260810 06:33:06.704083 13222 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:06.704777 13222 heartbeater.cc:511] Master 127.21.195.254:39725 requested a full tablet report, sending...
I20260810 06:33:06.708868 12918 ts_manager.cc:194] Registered new tserver with Master: cb05900f64f846db8bb616805e33febc (127.21.195.193:41279)
I20260810 06:33:06.713399 12918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:58275
I20260810 06:33:06.716879 13222 heartbeater.cc:503] Master 127.21.195.254:39725 was elected leader, sending a full tablet report...
I20260810 06:33:06.722153 13231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.713797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35806 (local address 127.21.195.193:41279)
0810 06:33:06.714621 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:06.714634 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:06.715511 (+ 877us) server_negotiation.cc:407] Connection header received
0810 06:33:06.715600 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:06.715606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:06.715830 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:06.716006 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:06.716517 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.717657 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.720378 (+ 2721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.721268 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.721427 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.721638 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:06.721851 (+ 213us) server_negotiation.cc:299] Negotiation successful
0810 06:33:06.721978 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":159,"threads_started":1}
I20260810 06:33:06.722157 13230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.712833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41279 (local address 127.0.0.1:35806)
0810 06:33:06.715136 (+ 2303us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:06.715194 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:06.715360 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:06.716189 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:06.716196 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:06.716229 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:06.716374 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.716382 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.717803 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.717808 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.720213 (+ 2405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.720229 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.721451 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.721455 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.721625 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.721678 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 06:33:06.721801 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:33:06.721990 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2084,"thread_start_us":164,"threads_started":1}
I20260810 06:33:06.723730 13115 tablet_service.cc:1514] Processing DeleteTablet for tablet 726fb590e2ff4327b56966806586d703 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:06 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:35806
I20260810 06:33:06.724948 13232 tablet_replica.cc:330] stopping tablet replica
I20260810 06:33:06.725322 13232 raft_consensus.cc:2229] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:33:06.725651 13232 raft_consensus.cc:2258] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:06.726897 13232 ts_tablet_manager.cc:1905] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:06.732028 13232 ts_tablet_manager.cc:1918] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:06.732177 13232 log.cc:1196] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/726fb590e2ff4327b56966806586d703
I20260810 06:33:06.732501 13232 ts_tablet_manager.cc:1939] T 726fb590e2ff4327b56966806586d703 P cb05900f64f846db8bb616805e33febc: Deleting consensus metadata
I20260810 06:33:06.734871 12896 catalog_manager.cc:4841] TS cb05900f64f846db8bb616805e33febc (127.21.195.193:41279): tablet 726fb590e2ff4327b56966806586d703 (table test-table [id=84cb4e280fc04b3da35d4d573d916ac5]) successfully deleted
W20260810 06:33:06.827634 13226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:06.827939 13226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:06.827984 13226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:06.832341 13226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:06.832424 13226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:06.832497 13226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:33:06.838451 13226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:40807
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=38859
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:06.839818 13226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:06.841035 13226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:06.852185 13241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:06.852197 13240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:06.852504 13226 server_base.cc:1034] running on GCE node
W20260810 06:33:06.852185 13244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:06.853097 13226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:06.853937 13226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:06.855113 13226 hybrid_clock.cc:648] HybridClock initialized: now 1786343586855076 us; error 64 us; skew 500 ppm
Aug 10 06:33:06 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343586, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:06.858188 13226 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:33:06.859301 13226 webserver.cc:460] Webserver started at http://127.21.195.194:38859/ using document root <none> and password file <none>
I20260810 06:33:06.859949 13226 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:06.860042 13226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:06.864557 13226 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:06.867046 13254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:06.868680 13226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:33:06.868805 13226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "b83f16f1b0bd4f10a790c5daee36cb03"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "141f2eec34acaaa9b8dc51c3623240b5"
server_key_iv: "067f97f4d4aebe6b65c6bac23f531ca6"
server_key_version: "encryptionkey@0"
I20260810 06:33:06.869486 13226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:06.881969 13226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:06.885802 13226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:06.886024 13226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:06.886773 13226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:06.888028 13226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:06.888087 13226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:06.888135 13226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:06.888162 13226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:06.899701 13226 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:40807
I20260810 06:33:06.899708 13437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:40807 every 8 connection(s)
I20260810 06:33:06.901371 13226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:33:06.911521 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 13226
I20260810 06:33:06.912060 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:40101
--local_ip_for_outbound_sockets=127.21.195.195
--tserver_master_addrs=127.21.195.254:39725
--webserver_port=44505
--webserver_interface=127.21.195.195
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:33:06 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343586, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:06.918177 13224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.903805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:50905 (local address 127.21.195.254:39725)
0810 06:33:06.903953 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:06.903956 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:06.905323 (+ 1367us) server_negotiation.cc:407] Connection header received
0810 06:33:06.906869 (+ 1546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:06.906873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:06.906957 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:06.907037 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:06.908599 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.909166 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.910470 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.910783 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.910893 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.914105 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:06.914110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:06.914113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:06.914146 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:06.915634 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:06.916310 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:06.916312 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:06.916313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:06.916395 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:06.916784 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:06.916786 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:06.916787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:06.916998 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:06.917072 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:06.917892 (+ 820us) server_negotiation.cc:299] Negotiation successful
0810 06:33:06.918039 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:33:06.919546 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:06.904500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:50905)
0810 06:33:06.905138 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:06.905190 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:06.906587 (+ 1397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:06.907296 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:06.907305 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:06.907791 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:06.908394 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.908410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.909305 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.909308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.910324 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:06.910335 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:06.910974 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:06.910978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:06.911196 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:06.911965 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:06.911984 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:06.913857 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:06.915782 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:06.915789 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:06.915810 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:06.916210 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:06.916477 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:06.916480 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:06.916482 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:06.916698 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:06.917112 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:06.917120 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:06.917560 (+ 440us) client_negotiation.cc:769] Sending connection context
0810 06:33:06.917818 (+ 258us) client_negotiation.cc:240] Negotiation successful
0810 06:33:06.918265 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":182,"threads_started":1}
I20260810 06:33:06.921002 13439 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39725
I20260810 06:33:06.921335 13439 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:06.922111 13439 heartbeater.cc:511] Master 127.21.195.254:39725 requested a full tablet report, sending...
I20260810 06:33:06.923534 12918 ts_manager.cc:194] Registered new tserver with Master: b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807)
I20260810 06:33:06.924201 12918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:50905
W20260810 06:33:07.040151 13442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:07.040494 13442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:07.040550 13442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:07.044958 13442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:07.045048 13442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:07.045117 13442 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:33:07.050958 13442 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:40101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=44505
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:07.052170 13442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:07.053326 13442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:07.064213 13449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:07.064237 13453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:07.064584 13442 server_base.cc:1034] running on GCE node
W20260810 06:33:07.064213 13450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:07.065084 13442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:07.065907 13442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:07.067109 13442 hybrid_clock.cc:648] HybridClock initialized: now 1786343587067092 us; error 27 us; skew 500 ppm
Aug 10 06:33:07 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343587, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:07.070216 13442 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:33:07.071259 13442 webserver.cc:460] Webserver started at http://127.21.195.195:44505/ using document root <none> and password file <none>
I20260810 06:33:07.071895 13442 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:07.071976 13442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:07.076902 13442 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:07.079360 13462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:07.080798 13442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:07.080937 13442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "2a2c792750e843e288dcc1af32f44306"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "ff0230170b3697605f0355e4716d28e6"
server_key_iv: "eb2730cc49c86fda842c5a02c595f638"
server_key_version: "encryptionkey@0"
I20260810 06:33:07.081590 13442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:07.103138 13442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:07.106477 13442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:07.106666 13442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:07.107363 13442 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:07.108378 13442 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:07.108434 13442 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:07.108479 13442 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:07.108500 13442 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:07.117913 13442 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:40101
I20260810 06:33:07.117935 13657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:40101 every 8 connection(s)
I20260810 06:33:07.119098 13442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:33:07.120872 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 13442
Aug 10 06:33:07 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343587, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:07.129954 13661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.121607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50726 (local address 127.21.195.254:39725)
0810 06:33:07.122200 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:07.122204 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:07.122215 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:33:07.122258 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:07.122261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:07.122301 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:07.122382 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:07.123232 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.123803 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.124791 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.125037 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.125130 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.126680 (+ 1550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:07.126684 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:07.126686 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:07.126711 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:07.128236 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:07.128651 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:07.128655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:07.128656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:07.128741 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:07.129012 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:07.129015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:07.129017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:07.129233 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:07.129450 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:07.129633 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 06:33:07.129769 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":98,"threads_started":1}
I20260810 06:33:07.133890 13224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.121172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:40987 (local address 127.21.195.254:39725)
0810 06:33:07.121335 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:07.121339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:07.122528 (+ 1189us) server_negotiation.cc:407] Connection header received
0810 06:33:07.123957 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:07.123959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:07.124012 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:07.124082 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:07.125359 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.126066 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.127375 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.127705 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.127818 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.130641 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:07.130645 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:07.130648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:07.130672 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:07.132060 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:07.132559 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:07.132561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:07.132562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:07.132631 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:07.132912 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:07.132915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:07.132916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:07.133076 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:07.133143 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:07.133665 (+ 522us) server_negotiation.cc:299] Negotiation successful
0810 06:33:07.133764 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 06:33:07.134898 13663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.121817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:40987)
0810 06:33:07.122375 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.122434 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:07.123766 (+ 1332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:07.124290 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:07.124298 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:07.124676 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:07.125208 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.125223 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.126198 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.126202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.127231 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.127246 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.127866 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.127870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.128037 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.128550 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:07.128569 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:07.130447 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:07.132182 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:07.132188 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:07.132209 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:07.132480 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:07.132696 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:07.132698 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:07.132700 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:07.132848 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:07.133146 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:07.133152 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:07.133415 (+ 263us) client_negotiation.cc:769] Sending connection context
0810 06:33:07.133631 (+ 216us) client_negotiation.cc:240] Negotiation successful
0810 06:33:07.133955 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":117,"threads_started":1}
I20260810 06:33:07.136099 13658 heartbeater.cc:347] Connected to a master server at 127.21.195.254:39725
I20260810 06:33:07.136369 13658 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:07.136919 13658 heartbeater.cc:511] Master 127.21.195.254:39725 requested a full tablet report, sending...
I20260810 06:33:07.138031 12918 ts_manager.cc:194] Registered new tserver with Master: 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101)
I20260810 06:33:07.138703 12918 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:40987
I20260810 06:33:07.143865 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:33:07.148087 13224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.144508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50728 (local address 127.21.195.254:39725)
0810 06:33:07.144628 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:07.144632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:07.144832 (+ 200us) server_negotiation.cc:407] Connection header received
0810 06:33:07.144977 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:07.144979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:07.145092 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:07.145180 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:33:07.145376 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.145959 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.146804 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.147013 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.147082 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.147335 (+ 253us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:33:07.147797 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:33:07.147892 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:07.147916 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 06:33:07.147972 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 06:33:07.148797 12918 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:33:07.152338 12918 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:33:07.160656 13115 tablet_service.cc:1467] Processing CreateTablet for tablet 664e900168ef43c6a2db8523b899f579 (DEFAULT_TABLE table=test-table [id=da23063cc9f545d29db3eb745944db7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:07.161466 13115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 664e900168ef43c6a2db8523b899f579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:07.164762 13671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.159902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:40101 (local address 127.0.0.1:45002)
0810 06:33:07.160209 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.160223 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:07.160310 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:07.161373 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:07.161376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:07.161394 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:07.161504 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.161535 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.162678 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.162681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.163529 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.163539 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.164357 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.164360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.164448 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.164475 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 06:33:07.164535 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:33:07.164609 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":2,"thread_start_us":124,"threads_started":1}
I20260810 06:33:07.164778 13054 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Bootstrap starting.
I20260810 06:33:07.164798 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.160419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45002 (local address 127.21.195.195:40101)
0810 06:33:07.160824 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:07.160837 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:07.160861 (+ 24us) server_negotiation.cc:407] Connection header received
0810 06:33:07.161012 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:07.161018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:07.161235 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:07.161376 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:07.161660 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.162528 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.163659 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.164234 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.164350 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.164520 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:07.164575 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 06:33:07.164673 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":180,"threads_started":1}
I20260810 06:33:07.165236 13230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.159590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:40807 (local address 127.0.0.1:57486)
0810 06:33:07.159704 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.159720 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:07.159821 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:07.160875 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:07.160879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:07.160900 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:07.161018 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.161024 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.162625 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.162629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.163684 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.163696 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.164867 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.164871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.164957 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.164982 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:33:07.165030 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 06:33:07.165108 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:33:07.165822 13054 tablet_bootstrap.cc:654] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:07.166035 13670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.159801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57486 (local address 127.21.195.194:40807)
0810 06:33:07.160340 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:07.160354 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:07.160379 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:33:07.160476 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:07.160483 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:07.160708 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:07.160902 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:07.161166 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.162308 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.163859 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.164721 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.165562 (+ 841us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.165720 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:07.165779 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 06:33:07.165888 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":162,"threads_started":1}
I20260810 06:33:07.168048 13054 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: No bootstrap required, opened a new log
I20260810 06:33:07.168159 13054 ts_tablet_manager.cc:1397] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:07.168604 13054 raft_consensus.cc:348] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.168715 13054 raft_consensus.cc:374] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:07.168753 13054 raft_consensus.cc:729] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb05900f64f846db8bb616805e33febc, State: Initialized, Role: FOLLOWER
I20260810 06:33:07.168933 13054 consensus_queue.cc:260] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.168808 13544 tablet_service.cc:1467] Processing CreateTablet for tablet 664e900168ef43c6a2db8523b899f579 (DEFAULT_TABLE table=test-table [id=da23063cc9f545d29db3eb745944db7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:07.169715 13054 ts_tablet_manager.cc:1428] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 06:33:07.169224 13325 tablet_service.cc:1467] Processing CreateTablet for tablet 664e900168ef43c6a2db8523b899f579 (DEFAULT_TABLE table=test-table [id=da23063cc9f545d29db3eb745944db7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:07.170177 13544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 664e900168ef43c6a2db8523b899f579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:07.170383 13325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 664e900168ef43c6a2db8523b899f579. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 06:33:07.178059 13223 tablet.cc:2369] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:33:07.179512 13676 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: Bootstrap starting.
I20260810 06:33:07.180408 13677 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: Bootstrap starting.
I20260810 06:33:07.183012 13676 tablet_bootstrap.cc:654] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:07.183019 13677 tablet_bootstrap.cc:654] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:07.183802 13676 log.cc:824] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:07.183806 13677 log.cc:824] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:07.186002 13677 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: No bootstrap required, opened a new log
I20260810 06:33:07.186013 13676 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: No bootstrap required, opened a new log
I20260810 06:33:07.186211 13676 ts_tablet_manager.cc:1397] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 06:33:07.186215 13677 ts_tablet_manager.cc:1397] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:33:07.189344 13676 raft_consensus.cc:348] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.189344 13677 raft_consensus.cc:348] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.189646 13676 raft_consensus.cc:374] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:07.189661 13677 raft_consensus.cc:374] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:07.189704 13676 raft_consensus.cc:729] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83f16f1b0bd4f10a790c5daee36cb03, State: Initialized, Role: FOLLOWER
I20260810 06:33:07.189733 13677 raft_consensus.cc:729] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a2c792750e843e288dcc1af32f44306, State: Initialized, Role: FOLLOWER
I20260810 06:33:07.190186 13676 consensus_queue.cc:260] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.190186 13677 consensus_queue.cc:260] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.190973 13658 heartbeater.cc:503] Master 127.21.195.254:39725 was elected leader, sending a full tablet report...
I20260810 06:33:07.191188 13439 heartbeater.cc:503] Master 127.21.195.254:39725 was elected leader, sending a full tablet report...
I20260810 06:33:07.191282 13676 ts_tablet_manager.cc:1428] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 06:33:07.191283 13677 ts_tablet_manager.cc:1428] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 06:33:07.284642 13681 raft_consensus.cc:482] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:07.284938 13681 raft_consensus.cc:504] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.286546 13681 leader_election.cc:288] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), cb05900f64f846db8bb616805e33febc (127.21.195.193:41279)
I20260810 06:33:07.290400 13670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.286870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:47735 (local address 127.21.195.194:40807)
0810 06:33:07.286994 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:07.286999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:07.287013 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:33:07.287172 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:07.287175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:07.287231 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:07.287305 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:07.287714 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.288230 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.289351 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.289805 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.289923 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.289984 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:07.290174 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 06:33:07.290256 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:33:07.290400 13663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.286748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:40807 (local address 127.21.195.195:47735)
0810 06:33:07.286896 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.286912 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:07.287029 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:07.287432 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:07.287435 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:07.287451 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:07.287578 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.287585 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.288351 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.288355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.289208 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.289217 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.289928 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.289932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.290049 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.290068 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 06:33:07.290135 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 06:33:07.290256 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":76}
I20260810 06:33:07.290416 13687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.286979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:59767 (local address 127.21.195.193:41279)
0810 06:33:07.287339 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:07.287345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:07.287361 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:33:07.287416 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:07.287418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:07.287470 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:07.287559 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:07.287860 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.288356 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.289372 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.289851 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.289964 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.290020 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:07.290198 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 06:33:07.290278 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":105,"threads_started":1}
I20260810 06:33:07.290423 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.286748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41279 (local address 127.21.195.195:59767)
0810 06:33:07.287252 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.287266 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:07.287344 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:07.287593 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:07.287597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:07.287616 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:07.287727 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.287732 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.288473 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.288476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.289243 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:07.289252 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.289963 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.289967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:07.290082 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.290100 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 06:33:07.290165 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:33:07.290274 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":158,"thread_start_us":119,"threads_started":1}
I20260810 06:33:07.291095 13358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "664e900168ef43c6a2db8523b899f579" candidate_uuid: "2a2c792750e843e288dcc1af32f44306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" is_pre_election: true
I20260810 06:33:07.291083 13146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "664e900168ef43c6a2db8523b899f579" candidate_uuid: "2a2c792750e843e288dcc1af32f44306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb05900f64f846db8bb616805e33febc" is_pre_election: true
I20260810 06:33:07.291424 13146 raft_consensus.cc:2454] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a2c792750e843e288dcc1af32f44306 in term 0.
I20260810 06:33:07.291424 13358 raft_consensus.cc:2454] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a2c792750e843e288dcc1af32f44306 in term 0.
I20260810 06:33:07.291890 13464 leader_election.cc:302] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a2c792750e843e288dcc1af32f44306, cb05900f64f846db8bb616805e33febc; no voters:
I20260810 06:33:07.292186 13681 raft_consensus.cc:2781] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:33:07.292280 13681 raft_consensus.cc:482] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:33:07.292331 13681 raft_consensus.cc:3037] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:07.293426 13681 raft_consensus.cc:504] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.293794 13681 leader_election.cc:288] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [CANDIDATE]: Term 1 election: Requested vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), cb05900f64f846db8bb616805e33febc (127.21.195.193:41279)
I20260810 06:33:07.294179 13358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "664e900168ef43c6a2db8523b899f579" candidate_uuid: "2a2c792750e843e288dcc1af32f44306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83f16f1b0bd4f10a790c5daee36cb03"
I20260810 06:33:07.294203 13146 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "664e900168ef43c6a2db8523b899f579" candidate_uuid: "2a2c792750e843e288dcc1af32f44306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb05900f64f846db8bb616805e33febc"
I20260810 06:33:07.294310 13358 raft_consensus.cc:3037] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:07.294348 13146 raft_consensus.cc:3037] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:07.295410 13358 raft_consensus.cc:2454] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a2c792750e843e288dcc1af32f44306 in term 1.
I20260810 06:33:07.295416 13146 raft_consensus.cc:2454] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a2c792750e843e288dcc1af32f44306 in term 1.
I20260810 06:33:07.295692 13463 leader_election.cc:302] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a2c792750e843e288dcc1af32f44306, b83f16f1b0bd4f10a790c5daee36cb03; no voters:
I20260810 06:33:07.295862 13681 raft_consensus.cc:2781] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:33:07.296085 13681 raft_consensus.cc:686] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 1 LEADER]: Becoming Leader. State: Replica: 2a2c792750e843e288dcc1af32f44306, State: Running, Role: LEADER
I20260810 06:33:07.296427 13681 consensus_queue.cc:237] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.299998 12918 catalog_manager.cc:5495] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a2c792750e843e288dcc1af32f44306 (127.21.195.195). New cstate: current_term: 1 leader_uuid: "2a2c792750e843e288dcc1af32f44306" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } health_report { overall_health: UNKNOWN } } }
I20260810 06:33:07.326500 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.322640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45010 (local address 127.21.195.195:40101)
0810 06:33:07.322799 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:07.322803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:07.322819 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:33:07.322922 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:07.322924 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:07.322985 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:07.323085 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:33:07.323377 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.323900 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.324786 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:07.325012 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:07.325105 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:07.325483 (+ 378us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:33:07.326020 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:33:07.326142 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:07.326241 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 06:33:07.326315 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 06:33:07.333438 13146 raft_consensus.cc:1261] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Refusing update from remote peer 2a2c792750e843e288dcc1af32f44306: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:07.333441 13358 raft_consensus.cc:1261] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 1 FOLLOWER]: Refusing update from remote peer 2a2c792750e843e288dcc1af32f44306: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:07.334429 13688 consensus_queue.cc:1035] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:07.334656 13681 consensus_queue.cc:1035] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:07.343847 13692 mvcc.cc:205] Tried to move back new op lower bound from 7316863333708816384 to 7316863333569163264. Current Snapshot: MvccSnapshot[applied={T|T < 7316863333708816384}]
I20260810 06:33:07.353415 12917 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:33:07.353664 12917 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:33:07.356261 12917 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Sending DeleteTablet for 3 replicas of tablet 664e900168ef43c6a2db8523b899f579
I20260810 06:33:07.357084 13115 tablet_service.cc:1514] Processing DeleteTablet for tablet 664e900168ef43c6a2db8523b899f579 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:07 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:35806
I20260810 06:33:07.357136 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 12982
I20260810 06:33:07.357192 13544 tablet_service.cc:1514] Processing DeleteTablet for tablet 664e900168ef43c6a2db8523b899f579 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:07 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:45002
I20260810 06:33:07.360577 13325 tablet_service.cc:1514] Processing DeleteTablet for tablet 664e900168ef43c6a2db8523b899f579 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:07 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:57486
I20260810 06:33:07.363305 13704 tablet_replica.cc:330] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: stopping tablet replica
I20260810 06:33:07.363813 13704 raft_consensus.cc:2229] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:33:07.364368 13704 raft_consensus.cc:2258] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:07.374516 13704 ts_tablet_manager.cc:1905] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:07.377921 13703 tablet_replica.cc:330] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: stopping tablet replica
I20260810 06:33:07.377976 13704 ts_tablet_manager.cc:1918] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:07.378098 13704 log.cc:1196] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/664e900168ef43c6a2db8523b899f579
I20260810 06:33:07.378472 13704 ts_tablet_manager.cc:1939] T 664e900168ef43c6a2db8523b899f579 P b83f16f1b0bd4f10a790c5daee36cb03: Deleting consensus metadata
I20260810 06:33:07.378671 13703 raft_consensus.cc:2229] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:33:07.379310 13703 raft_consensus.cc:2258] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 06:33:07.379680 12896 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:41279 (error 108)
I20260810 06:33:07.380489 12895 catalog_manager.cc:4841] TS b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807): tablet 664e900168ef43c6a2db8523b899f579 (table test-table [id=da23063cc9f545d29db3eb745944db7b]) successfully deleted
I20260810 06:33:07.380661 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 13226
I20260810 06:33:07.406658 13703 ts_tablet_manager.cc:1905] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:07.410681 13703 ts_tablet_manager.cc:1918] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:07.410980 13703 log.cc:1196] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/664e900168ef43c6a2db8523b899f579
I20260810 06:33:07.411523 13703 ts_tablet_manager.cc:1939] T 664e900168ef43c6a2db8523b899f579 P 2a2c792750e843e288dcc1af32f44306: Deleting consensus metadata
I20260810 06:33:07.418462 13230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.418055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:41279 (local address 127.0.0.1:35820)
0810 06:33:07.418234 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.418353 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:41279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260810 06:33:07.418685 12896 catalog_manager.cc:4584] TS cb05900f64f846db8bb616805e33febc (127.21.195.193:41279): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 664e900168ef43c6a2db8523b899f579: Network error: Client connection negotiation failed: client connection to 127.21.195.193:41279: connect: Connection refused (error 111)
I20260810 06:33:07.419721 12899 catalog_manager.cc:4841] TS 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101): tablet 664e900168ef43c6a2db8523b899f579 (table test-table [id=da23063cc9f545d29db3eb745944db7b]) successfully deleted
I20260810 06:33:07.426025 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 13442
I20260810 06:33:07.442566 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 12865
I20260810 06:33:07.463588 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39725
--webserver_interface=127.21.195.254
--webserver_port=34343
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:39725
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:07.586966 13708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:07.587313 13708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:07.587384 13708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:07.591627 13708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:33:07.591707 13708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:07.591735 13708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:07.591756 13708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:33:07.591775 13708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:33:07.597692 13708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:39725
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=34343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:07.598963 13708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:07.600169 13708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:07.609637 13716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:07.609745 13708 server_base.cc:1034] running on GCE node
W20260810 06:33:07.609655 13720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:07.609655 13722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:07.610611 13708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:07.611900 13708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:07.613080 13708 hybrid_clock.cc:648] HybridClock initialized: now 1786343587613057 us; error 41 us; skew 500 ppm
Aug 10 06:33:07 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343587, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:07.616163 13708 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:33:07.617271 13708 webserver.cc:460] Webserver started at http://127.21.195.254:34343/ using document root <none> and password file <none>
I20260810 06:33:07.617947 13708 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:07.618031 13708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:07.622309 13708 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:33:07.624756 13732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:07.626250 13708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:07.626391 13708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "3ab3657c78504f7aada43f734a6b6559"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "0c0e4b1d67db6114b63fee9dd2769782"
server_key_iv: "3c1e2ab5d690793080e5a653dec6f95f"
server_key_version: "encryptionkey@0"
I20260810 06:33:07.627024 13708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:07.647760 13708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:07.651264 13708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:07.651489 13708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:07.659228 13708 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:39725
I20260810 06:33:07.659497 13821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:39725 every 8 connection(s)
I20260810 06:33:07.660564 13708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:33:07.661651 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 13708
I20260810 06:33:07.662153 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:41279
--local_ip_for_outbound_sockets=127.21.195.193
--tserver_master_addrs=127.21.195.254:39725
--webserver_port=37575
--webserver_interface=127.21.195.193
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:07.666278 13823 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:33:07.668334 13823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Bootstrap starting.
I20260810 06:33:07.686693 13823 log.cc:824] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:07.699360 13823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:33:07.699803 13823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559: Bootstrap complete.
I20260810 06:33:07.703967 13823 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:07.704444 13823 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ab3657c78504f7aada43f734a6b6559, State: Initialized, Role: FOLLOWER
I20260810 06:33:07.705008 13823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:07.705152 13823 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:33:07.705222 13823 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:33:07.705325 13823 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 2 FOLLOWER]: Advancing to term 3
I20260810 06:33:07.707511 13823 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:07.707887 13823 leader_election.cc:302] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ab3657c78504f7aada43f734a6b6559; no voters:
I20260810 06:33:07.708257 13823 leader_election.cc:288] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 06:33:07.708438 13828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 06:33:07.708750 13828 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [term 3 LEADER]: Becoming Leader. State: Replica: 3ab3657c78504f7aada43f734a6b6559, State: Running, Role: LEADER
I20260810 06:33:07.709141 13828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } }
I20260810 06:33:07.709697 13823 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:33:07.710937 13830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ab3657c78504f7aada43f734a6b6559. Latest consensus state: current_term: 3 leader_uuid: "3ab3657c78504f7aada43f734a6b6559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } } }
I20260810 06:33:07.710942 13829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3ab3657c78504f7aada43f734a6b6559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ab3657c78504f7aada43f734a6b6559" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39725 } } }
I20260810 06:33:07.711079 13830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:07.711081 13829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ab3657c78504f7aada43f734a6b6559 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:07.711486 13840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:33:07.717087 13840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:33:07.717867 13840 catalog_manager.cc:1259] Loaded cluster ID: ba2b42779a504a24953377ce9a6b7a08
I20260810 06:33:07.717928 13840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 06:33:07.719133 13840 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f30b08f79ad google::LogMessage::Fail() at ??:0
@ 0x7f30b08fa88a google::LogMessage::SendToLog() at ??:0
@ 0x7f30b08f74de google::LogMessage::Flush() at ??:0
@ 0x7f30b08f8a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f30bb23afdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f30bb23bd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f30bb238579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f30bb27c640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f30b2b493d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f30b2b49c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f30b2b4b3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f30b2b3a512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f30b417e6db start_thread at ??:0
@ 0x7f30af3f561f clone at ??:0
W20260810 06:33:07.806102 13825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:07.806406 13825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:07.806489 13825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:07.810752 13825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:07.810823 13825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:07.810910 13825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:33:07.816733 13825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:41279
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=37575
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:07.818091 13825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:07.819254 13825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:07.830361 13886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:07.830427 13825 server_base.cc:1034] running on GCE node
W20260810 06:33:07.830354 13889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:07.830679 13883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:07.831259 13825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:07.832007 13825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:07.833187 13825 hybrid_clock.cc:648] HybridClock initialized: now 1786343587833151 us; error 71 us; skew 500 ppm
Aug 10 06:33:07 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343587, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:07.836256 13825 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:33:07.837319 13825 webserver.cc:460] Webserver started at http://127.21.195.193:37575/ using document root <none> and password file <none>
I20260810 06:33:07.838090 13825 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:07.838191 13825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:07.843454 13825 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260810 06:33:07.846105 13900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:07.847719 13825 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:07.847887 13825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "cb05900f64f846db8bb616805e33febc"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "11e90adbe9c809eb8434d0230006d246"
server_key_iv: "8556690993b67aaba4936141730ef5df"
server_key_version: "encryptionkey@0"
I20260810 06:33:07.848516 13825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:07.865581 13825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:07.869329 13825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:07.869587 13825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:07.870288 13825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:07.871644 13913 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 06:33:07.877940 13825 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 06:33:07.878036 13825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20260810 06:33:07.878115 13825 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 06:33:07.880012 13825 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 06:33:07.880067 13825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 06:33:07.880470 13913 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Bootstrap starting.
I20260810 06:33:07.890779 13825 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:41279
I20260810 06:33:07.891189 14078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:41279 every 8 connection(s)
I20260810 06:33:07.891981 13825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:33:07.901484 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 13825
I20260810 06:33:07.901813 13913 log.cc:824] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:07.902063 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:40807
--local_ip_for_outbound_sockets=127.21.195.194
--tserver_master_addrs=127.21.195.254:39725
--webserver_port=38859
--webserver_interface=127.21.195.194
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:07.912392 13913 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:33:07.912916 13913 tablet_bootstrap.cc:492] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Bootstrap complete.
I20260810 06:33:07.914386 13913 ts_tablet_manager.cc:1397] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Time spent bootstrapping tablet: real 0.034s user 0.019s sys 0.014s
I20260810 06:33:07.918187 13913 raft_consensus.cc:348] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.918833 13913 raft_consensus.cc:729] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb05900f64f846db8bb616805e33febc, State: Initialized, Role: FOLLOWER
I20260810 06:33:07.919461 13913 consensus_queue.cc:260] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:07.920671 13913 ts_tablet_manager.cc:1428] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
W20260810 06:33:07.947743 14081 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:33:07.894588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:33945)
0810 06:33:07.895296 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.895364 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:07.896485 (+ 1121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:07.946673 (+ 50188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":200,"threads_started":1}
W20260810 06:33:07.948359 14079 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:39725 (0 consecutive failures): Network error: Failed to ping master at 127.21.195.254:39725: Client connection negotiation failed: client connection to 127.21.195.254:39725: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 06:33:07.949223 14081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.948897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:58747)
0810 06:33:07.949059 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.949152 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 06:33:07.950002 14081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:07.949774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:47253)
0810 06:33:07.949888 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:07.949941 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 06:33:07.950187 14079 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:33:08.034039 14087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:08.034359 14087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:08.034406 14087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:08.038655 14087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:08.038740 14087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:08.038820 14087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:33:08.044968 14087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:40807
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=38859
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:08.046360 14087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:08.047591 14087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:33:08.059098 14087 server_base.cc:1034] running on GCE node
W20260810 06:33:08.059077 14095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:08.059047 14097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:08.059049 14099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:08.059806 14087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:08.060539 14087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:08.061702 14087 hybrid_clock.cc:648] HybridClock initialized: now 1786343588061676 us; error 50 us; skew 500 ppm
Aug 10 06:33:08 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343588, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:08.064988 14087 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:33:08.066112 14087 webserver.cc:460] Webserver started at http://127.21.195.194:38859/ using document root <none> and password file <none>
I20260810 06:33:08.066763 14087 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:08.066849 14087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:08.071388 14087 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:33:08.073959 14107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:08.075322 14087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:08.075455 14087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "b83f16f1b0bd4f10a790c5daee36cb03"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "141f2eec34acaaa9b8dc51c3623240b5"
server_key_iv: "067f97f4d4aebe6b65c6bac23f531ca6"
server_key_version: "encryptionkey@0"
I20260810 06:33:08.076107 14087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:08.094449 14087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:08.097990 14087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:08.098212 14087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:08.098930 14087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:08.099961 14087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:08.100015 14087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:08.100075 14087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:08.100106 14087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:08.109476 14087 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:40807
I20260810 06:33:08.109504 14297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:40807 every 8 connection(s)
I20260810 06:33:08.110720 14087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:33:08.113754 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 14087
I20260810 06:33:08.114300 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:40101
--local_ip_for_outbound_sockets=127.21.195.195
--tserver_master_addrs=127.21.195.254:39725
--webserver_port=44505
--webserver_interface=127.21.195.195
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:42865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:08.115622 14300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:08.113197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:49845)
0810 06:33:08.113840 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:08.114452 (+ 612us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":126,"threads_started":1}
W20260810 06:33:08.116192 14298 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:39725 (0 consecutive failures): Network error: Failed to ping master at 127.21.195.254:39725: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
I20260810 06:33:08.116993 14300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:08.116736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:60883)
0810 06:33:08.116865 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:08.116924 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260810 06:33:08.117746 14300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:08.117545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:53273)
0810 06:33:08.117640 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:08.117687 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 06:33:08.117923 14298 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:33:08.237970 14302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:08.238286 14302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:08.238356 14302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:08.242558 14302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:08.242640 14302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:08.242714 14302 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:33:08.248446 14302 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:40101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=44505
--tserver_master_addrs=127.21.195.254:39725
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:08.249802 14302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:08.250988 14302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:08.261894 14319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:08.261943 14302 server_base.cc:1034] running on GCE node
W20260810 06:33:08.261894 14327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:08.261914 14322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:08.262773 14302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:08.263556 14302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:08.264732 14302 hybrid_clock.cc:648] HybridClock initialized: now 1786343588264709 us; error 39 us; skew 500 ppm
Aug 10 06:33:08 dist-test-slave-7lbf krb5kdc[11974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343588, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:08.267882 14302 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:33:08.268929 14302 webserver.cc:460] Webserver started at http://127.21.195.195:44505/ using document root <none> and password file <none>
I20260810 06:33:08.269625 14302 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:08.269716 14302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:08.274250 14302 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:08.276746 14338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:08.278230 14302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 06:33:08.278383 14302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "2a2c792750e843e288dcc1af32f44306"
format_stamp: "Formatted at 2026-08-10 06:33:05 on dist-test-slave-7lbf"
server_key: "ff0230170b3697605f0355e4716d28e6"
server_key_iv: "eb2730cc49c86fda842c5a02c595f638"
server_key_version: "encryptionkey@0"
I20260810 06:33:08.279028 14302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:08.293354 14302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:08.296990 14302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:08.297183 14302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:08.297914 14302 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:08.298861 14302 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:08.298926 14302 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:08.298977 14302 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:08.298998 14302 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:08.308482 14302 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:40101
I20260810 06:33:08.308501 14528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:40101 every 8 connection(s)
I20260810 06:33:08.309689 14302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:33:08.313381 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 14302
I20260810 06:33:08.314006 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:08.312104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:53721)
0810 06:33:08.312621 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:08.313099 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":116,"threads_started":1}
W20260810 06:33:08.314577 14530 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:39725 (0 consecutive failures): Network error: Failed to ping master at 127.21.195.254:39725: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
I20260810 06:33:08.315210 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:08.314992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:39023)
0810 06:33:08.315099 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:08.315149 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 06:33:08.315856 14532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:08.315651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:38183)
0810 06:33:08.315755 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:08.315801 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:33:08.316027 14530 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 06:33:08.951310 14534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:08.950819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:36361)
0810 06:33:08.951109 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:08.951176 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":84,"threads_started":1}
I20260810 06:33:09.119036 14536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:09.118579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:36321)
0810 06:33:09.118834 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:09.118908 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":82,"threads_started":1}
I20260810 06:33:09.317179 14537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:09.316700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:41751)
0810 06:33:09.316980 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:09.317042 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":78,"threads_started":1}
I20260810 06:33:09.707242 14539 raft_consensus.cc:482] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:09.707475 14539 raft_consensus.cc:504] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:09.708706 14539 leader_election.cc:288] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101)
Aug 10 06:33:09 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343587, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.194@KRBTEST.COM
Aug 10 06:33:09 dist-test-slave-7lbf krb5kdc[11974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343587, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.195@KRBTEST.COM
I20260810 06:33:09.737027 14542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:09.708930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:40807 (local address 127.21.195.193:49949)
0810 06:33:09.709242 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:09.709257 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:09.709372 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:09.711306 (+ 1934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:09.711322 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:09.711852 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:09.712412 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:09.712422 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:09.713809 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:09.713813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:09.714808 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:09.714819 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:09.715576 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:09.715579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:09.715792 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:09.728411 (+ 12619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:09.728442 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:09.730479 (+ 2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:09.733424 (+ 2945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:09.733433 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:09.733454 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:09.734023 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:09.734482 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:09.734486 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:09.734488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:09.734745 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:09.735687 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:09.735696 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:09.736129 (+ 433us) client_negotiation.cc:769] Sending connection context
0810 06:33:09.736374 (+ 245us) client_negotiation.cc:240] Negotiation successful
0810 06:33:09.736779 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":158,"spinlock_wait_cycles":47616,"thread_start_us":96,"threads_started":1}
I20260810 06:33:09.737097 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:09.709156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:49949 (local address 127.21.195.194:40807)
0810 06:33:09.709466 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:09.709485 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:09.709555 (+ 70us) server_negotiation.cc:407] Connection header received
0810 06:33:09.710479 (+ 924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:09.710489 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:09.710900 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:09.711161 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:09.712598 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:09.713661 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:09.714952 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:09.715440 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:09.715610 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:09.730889 (+ 15279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:09.730900 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:09.730934 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:09.730984 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:09.733224 (+ 2240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:09.734163 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:09.734171 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:09.734178 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:09.734370 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:09.734845 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:09.734848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:09.734850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:09.735518 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:09.735671 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:09.736540 (+ 869us) server_negotiation.cc:299] Negotiation successful
0810 06:33:09.736886 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":87,"threads_started":1}
I20260810 06:33:09.737027 14541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:09.709022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:40101 (local address 127.21.195.193:53757)
0810 06:33:09.709984 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:09.709999 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:09.710107 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:09.711477 (+ 1370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:09.711480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:09.711853 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:09.712403 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:09.712422 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:09.713820 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:09.713823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:09.714810 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:09.714820 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:09.715576 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:09.715580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:09.715794 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:09.728408 (+ 12614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:09.728454 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:09.730723 (+ 2269us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:09.733424 (+ 2701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:09.733433 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:09.733454 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:09.734023 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:09.734482 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:09.734486 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:09.734488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:09.734744 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:09.735687 (+ 943us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:09.735696 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:09.736129 (+ 433us) client_negotiation.cc:769] Sending connection context
0810 06:33:09.736374 (+ 245us) client_negotiation.cc:240] Negotiation successful
0810 06:33:09.736862 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"mutex_wait_us":323,"spinlock_wait_cycles":61312,"thread_start_us":64,"threads_started":1}
I20260810 06:33:09.737155 14545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:09.709592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:53757 (local address 127.21.195.195:40101)
0810 06:33:09.709886 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:09.709909 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:09.710084 (+ 175us) server_negotiation.cc:407] Connection header received
0810 06:33:09.710836 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:09.710843 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:09.711193 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:09.711517 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:09.712595 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:09.713665 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:09.714940 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:09.715438 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:09.715604 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:09.730960 (+ 15356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:09.730967 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:09.730978 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:09.731014 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:09.733224 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:09.734163 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:09.734170 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:09.734178 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:09.734370 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:09.734854 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:09.734858 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:09.734859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:09.735518 (+ 659us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:09.735671 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:09.736541 (+ 870us) server_negotiation.cc:299] Negotiation successful
0810 06:33:09.736886 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":80,"threads_started":1}
W20260810 06:33:09.740404 13902 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
W20260810 06:33:09.740605 13908 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
I20260810 06:33:09.740684 13908 leader_election.cc:302] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb05900f64f846db8bb616805e33febc; no voters: 2a2c792750e843e288dcc1af32f44306, b83f16f1b0bd4f10a790c5daee36cb03
I20260810 06:33:09.740972 14539 raft_consensus.cc:2726] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:33:09.952521 14541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:09.952127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:36765)
0810 06:33:09.952318 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:09.952409 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260810 06:33:10.120453 14546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:10.119909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:34489)
0810 06:33:10.120241 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:10.120313 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":100,"threads_started":1}
I20260810 06:33:10.318665 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:10.318138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:49595)
0810 06:33:10.318445 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:10.318549 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":82,"threads_started":1}
I20260810 06:33:10.953940 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:10.953432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:44487)
0810 06:33:10.953741 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:10.953812 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":121,"threads_started":1}
I20260810 06:33:11.121940 14553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:11.121383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:48437)
0810 06:33:11.121749 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:11.121820 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":90,"threads_started":1}
I20260810 06:33:11.319972 14554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:11.319524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:57547)
0810 06:33:11.319794 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:11.319860 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":85,"threads_started":1}
I20260810 06:33:11.487149 14555 raft_consensus.cc:482] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:11.487294 14555 raft_consensus.cc:504] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:11.487757 14555 leader_election.cc:288] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101)
W20260810 06:33:11.488579 13902 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
W20260810 06:33:11.488704 13908 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
I20260810 06:33:11.488796 13908 leader_election.cc:302] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb05900f64f846db8bb616805e33febc; no voters: 2a2c792750e843e288dcc1af32f44306, b83f16f1b0bd4f10a790c5daee36cb03
I20260810 06:33:11.488958 14555 raft_consensus.cc:2726] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:33:11.955238 14559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:11.954745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:45853)
0810 06:33:11.955046 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:11.955128 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":89,"threads_started":1}
I20260810 06:33:12.123345 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:12.122857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:45869)
0810 06:33:12.123149 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:12.123217 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":108,"threads_started":1}
I20260810 06:33:12.321292 14562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:12.320800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:44323)
0810 06:33:12.321105 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:12.321177 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":83,"threads_started":1}
I20260810 06:33:12.956964 14563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:12.956354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:52857)
0810 06:33:12.956747 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:12.956833 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":114,"threads_started":1}
I20260810 06:33:13.124842 14565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:13.124295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:34813)
0810 06:33:13.124658 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:13.124729 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":104,"threads_started":1}
I20260810 06:33:13.266549 14566 raft_consensus.cc:482] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:13.266702 14566 raft_consensus.cc:504] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:13.267202 14566 leader_election.cc:288] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101)
W20260810 06:33:13.268064 13908 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
W20260810 06:33:13.268190 13902 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
I20260810 06:33:13.268294 13902 leader_election.cc:302] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb05900f64f846db8bb616805e33febc; no voters: 2a2c792750e843e288dcc1af32f44306, b83f16f1b0bd4f10a790c5daee36cb03
I20260810 06:33:13.268481 14566 raft_consensus.cc:2726] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:33:13.326028 14570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:13.325559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:42375)
0810 06:33:13.325849 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:13.325916 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":79,"threads_started":1}
I20260810 06:33:13.958504 14575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:13.957971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:53699)
0810 06:33:13.958317 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:13.958393 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":120,"threads_started":1}
I20260810 06:33:14.126456 14576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:14.125885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:59077)
0810 06:33:14.126246 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:14.126322 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":89,"threads_started":1}
I20260810 06:33:14.327507 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:14.326956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:60997)
0810 06:33:14.327273 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:14.327364 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":94,"threads_started":1}
I20260810 06:33:14.959931 14578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:14.959442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:49931)
0810 06:33:14.959743 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:14.959819 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":92,"threads_started":1}
I20260810 06:33:15.127933 14580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:15.127419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:49247)
0810 06:33:15.127748 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:15.127826 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":82,"threads_started":1}
I20260810 06:33:15.328922 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:15.328396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:49087)
0810 06:33:15.328732 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:15.328798 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":99,"threads_started":1}
I20260810 06:33:15.961409 14584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:15.960878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:53043)
0810 06:33:15.961173 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:15.961278 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":99,"threads_started":1}
I20260810 06:33:16.129351 14586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:16.128834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:41241)
0810 06:33:16.129155 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:16.129220 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":96,"threads_started":1}
I20260810 06:33:16.330186 14590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:16.329744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:34417)
0810 06:33:16.330021 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:16.330082 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":103,"threads_started":1}
I20260810 06:33:16.962810 14591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:16.962330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:51419)
0810 06:33:16.962637 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:16.962703 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":104,"threads_started":1}
I20260810 06:33:17.130846 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:17.130315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:58617)
0810 06:33:17.130667 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:17.130736 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":116,"threads_started":1}
I20260810 06:33:17.331437 14594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:17.330968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:49703)
0810 06:33:17.331266 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:17.331332 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":105,"threads_started":1}
I20260810 06:33:17.869130 14595 raft_consensus.cc:482] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:17.869294 14595 raft_consensus.cc:504] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:17.869836 14595 leader_election.cc:288] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101)
W20260810 06:33:17.870733 13902 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
W20260810 06:33:17.870863 13908 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
I20260810 06:33:17.870930 13908 leader_election.cc:302] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb05900f64f846db8bb616805e33febc; no voters: 2a2c792750e843e288dcc1af32f44306, b83f16f1b0bd4f10a790c5daee36cb03
I20260810 06:33:17.871083 14595 raft_consensus.cc:2726] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:33:17.964239 14597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:17.963788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:51221)
0810 06:33:17.964072 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:17.964135 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":91,"threads_started":1}
I20260810 06:33:18.132279 14599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:18.131793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:38219)
0810 06:33:18.132104 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:18.132171 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":108,"threads_started":1}
I20260810 06:33:18.332852 14601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:18.332331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:48159)
0810 06:33:18.332674 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:18.332743 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":106,"threads_started":1}
I20260810 06:33:18.965703 14602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:18.965173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:42469)
0810 06:33:18.965470 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:18.965585 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":97,"threads_started":1}
I20260810 06:33:19.133762 14606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:19.133217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:42675)
0810 06:33:19.133572 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:19.133649 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":87,"threads_started":1}
I20260810 06:33:19.334578 14610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:19.333948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:57949)
0810 06:33:19.334368 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:19.334447 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":97,"threads_started":1}
I20260810 06:33:19.966984 14611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:19.966497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:53715)
0810 06:33:19.966802 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:19.966873 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":86,"threads_started":1}
I20260810 06:33:20.135737 14612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:20.134803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:40509)
0810 06:33:20.135457 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:20.135575 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":242,"threads_started":1}
I20260810 06:33:20.336571 14615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:20.335766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:57093)
0810 06:33:20.336281 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:20.336394 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":164,"threads_started":1}
I20260810 06:33:20.968973 14617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:20.968106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:45613)
0810 06:33:20.968580 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:20.968725 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":125,"threads_started":1}
I20260810 06:33:21.137943 14618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:21.137111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:49151)
0810 06:33:21.137673 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:21.137778 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":175,"threads_started":1}
I20260810 06:33:21.338238 14619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:21.337672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:46137)
0810 06:33:21.338046 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:21.338126 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":84,"threads_started":1}
I20260810 06:33:21.446420 14620 raft_consensus.cc:482] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:21.446571 14620 raft_consensus.cc:504] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83f16f1b0bd4f10a790c5daee36cb03" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40807 } } peers { permanent_uuid: "2a2c792750e843e288dcc1af32f44306" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 40101 } } peers { permanent_uuid: "cb05900f64f846db8bb616805e33febc" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 41279 } }
I20260810 06:33:21.447053 14620 leader_election.cc:288] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807), 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101)
W20260810 06:33:21.448033 13902 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b83f16f1b0bd4f10a790c5daee36cb03 (127.21.195.194:40807): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
W20260810 06:33:21.448167 13908 leader_election.cc:341] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2a2c792750e843e288dcc1af32f44306 (127.21.195.195:40101): Not found: Tablet not found: 664e900168ef43c6a2db8523b899f579
I20260810 06:33:21.448235 13908 leader_election.cc:302] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cb05900f64f846db8bb616805e33febc; no voters: 2a2c792750e843e288dcc1af32f44306, b83f16f1b0bd4f10a790c5daee36cb03
I20260810 06:33:21.448388 14620 raft_consensus.cc:2726] T 664e900168ef43c6a2db8523b899f579 P cb05900f64f846db8bb616805e33febc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:33:21.970599 14626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:21.970077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:57063)
0810 06:33:21.970394 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:21.970465 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":111,"threads_started":1}
I20260810 06:33:22.139355 14627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:22.138843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:59351)
0810 06:33:22.139173 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:22.139237 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":108,"threads_started":1}
I20260810 06:33:22.339526 14628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:22.339083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:39029)
0810 06:33:22.339345 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:22.339411 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":89,"threads_started":1}
I20260810 06:33:22.972216 14629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:22.971738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.193:45647)
0810 06:33:22.972047 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:22.972114 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":91,"threads_started":1}
I20260810 06:33:23.140981 14631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:23.140452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.194:42415)
0810 06:33:23.140789 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:23.140851 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":119,"threads_started":1}
I20260810 06:33:23.318499 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 13825
I20260810 06:33:23.332717 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 14087
I20260810 06:33:23.343072 14632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:23.341150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:39725 (local address 127.21.195.195:38969)
0810 06:33:23.342889 (+ 1739us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:23.342967 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:39725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1633,"thread_start_us":1504,"threads_started":1}
I20260810 06:33:23.348902 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 14302
2026-08-10T06:33:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19798 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:33:23 dist-test-slave-7lbf krb5kdc[14635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:33:23 dist-test-slave-7lbf krb5kdc[14635](info): set up 2 sockets
Aug 10 06:33:23 dist-test-slave-7lbf krb5kdc[14635](info): commencing operation
krb5kdc: starting...
W20260810 06:33:24.538633 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:33:24 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:33:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:33:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:33:24.671047 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35219
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:35219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:24.799539 14661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:24.799870 14661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:24.799933 14661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:24.804370 14661 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 06:33:24.804452 14661 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 06:33:24.804474 14661 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 06:33:24.804491 14661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:33:24.804519 14661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:24.804553 14661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:24.804584 14661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:33:24.804613 14661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:33:24.810582 14661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:35219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:24.811858 14661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:24.813045 14661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:24.822608 14673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:24.822661 14669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:24.822659 14661 server_base.cc:1034] running on GCE node
W20260810 06:33:24.822932 14670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:24.823581 14661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:24.824792 14661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:24.825990 14661 hybrid_clock.cc:648] HybridClock initialized: now 1786343604825959 us; error 51 us; skew 500 ppm
Aug 10 06:33:24 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343604, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:24.829017 14661 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:33:24.830142 14661 webserver.cc:460] Webserver started at http://127.21.195.254:44405/ using document root <none> and password file <none>
I20260810 06:33:24.830788 14661 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:24.830866 14661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:24.831086 14661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:24.833356 14661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "391e2c3ed85e43ad9abea4958f852cc9"
format_stamp: "Formatted at 2026-08-10 06:33:24 on dist-test-slave-7lbf"
server_key: "06495000d34ae740e017a777dabaff3e"
server_key_iv: "bacc8e2418b4ab041bcf64ecc0ad6200"
server_key_version: "encryptionkey@0"
I20260810 06:33:24.834014 14661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "391e2c3ed85e43ad9abea4958f852cc9"
format_stamp: "Formatted at 2026-08-10 06:33:24 on dist-test-slave-7lbf"
server_key: "06495000d34ae740e017a777dabaff3e"
server_key_iv: "bacc8e2418b4ab041bcf64ecc0ad6200"
server_key_version: "encryptionkey@0"
I20260810 06:33:24.838254 14661 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:33:24.841010 14685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:24.842446 14661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:24.842587 14661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "391e2c3ed85e43ad9abea4958f852cc9"
format_stamp: "Formatted at 2026-08-10 06:33:24 on dist-test-slave-7lbf"
server_key: "06495000d34ae740e017a777dabaff3e"
server_key_iv: "bacc8e2418b4ab041bcf64ecc0ad6200"
server_key_version: "encryptionkey@0"
I20260810 06:33:24.842710 14661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:24.862099 14661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:24.865267 14661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:24.865480 14661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:24.873414 14661 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:35219
I20260810 06:33:24.873723 14766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:35219 every 8 connection(s)
I20260810 06:33:24.874625 14661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:33:24.877897 14767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:24.880918 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 14661
I20260810 06:33:24.881045 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:33:24.881326 22287 external_mini_cluster.cc:1428] Setting key 2c637a2af960cd6aca3d8d5df090d514
I20260810 06:33:24.884722 14767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Bootstrap starting.
I20260810 06:33:24.887638 14767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:24.888597 14767 log.cc:824] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:33:24 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:24.891124 14767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: No bootstrap required, opened a new log
I20260810 06:33:24.895148 14767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:33:24.895442 14767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:24.895525 14767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391e2c3ed85e43ad9abea4958f852cc9, State: Initialized, Role: FOLLOWER
I20260810 06:33:24.896025 14767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:33:24.896174 14767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:33:24.896246 14767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:33:24.896349 14767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:24.896667 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:24.882913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45076 (local address 127.21.195.254:35219)
0810 06:33:24.883433 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:24.883452 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:24.883494 (+ 42us) server_negotiation.cc:407] Connection header received
0810 06:33:24.884182 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:24.884201 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:24.884651 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:24.885029 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:24.886038 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:24.887087 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:24.888260 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:24.888808 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:24.888934 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:24.891770 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:24.891776 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:24.891794 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:24.891826 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:24.893456 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:24.893932 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:24.893938 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:24.893943 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:24.894073 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:24.894359 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:24.894362 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:24.894363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:24.894829 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:24.895042 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:24.895348 (+ 306us) server_negotiation.cc:299] Negotiation successful
0810 06:33:24.895706 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":146,"threads_started":1}
I20260810 06:33:24.897434 14767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:33:24.897861 14767 leader_election.cc:302] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 391e2c3ed85e43ad9abea4958f852cc9; no voters:
I20260810 06:33:24.898257 14767 leader_election.cc:288] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:33:24.898355 14776 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:33:24.898568 14776 raft_consensus.cc:686] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 1 LEADER]: Becoming Leader. State: Replica: 391e2c3ed85e43ad9abea4958f852cc9, State: Running, Role: LEADER
I20260810 06:33:24.898928 14776 consensus_queue.cc:237] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:33:24.899657 14767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:33:24.900245 14776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 391e2c3ed85e43ad9abea4958f852cc9. Latest consensus state: current_term: 1 leader_uuid: "391e2c3ed85e43ad9abea4958f852cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } } }
I20260810 06:33:24.900377 14776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:24.900676 14777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "391e2c3ed85e43ad9abea4958f852cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } } }
I20260810 06:33:24.900799 14777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:24.901124 14785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:33:24.904618 14785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:33:24.910972 14785 catalog_manager.cc:1347] Generated new cluster ID: e0b062498031457ba7e93550834811e4
I20260810 06:33:24.911065 14785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:33:24.923954 14785 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:33:24.925395 14785 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:33:24.935079 14785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Generated new TSK 0
I20260810 06:33:24.936132 14785 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:33:24.965988 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35219
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:25.092087 14809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:25.092417 14809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:25.092464 14809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:25.096810 14809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:25.096907 14809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:25.096973 14809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:33:25.102882 14809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:25.104193 14809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:25.105440 14809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:25.116492 14820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:25.116521 14818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:25.116518 14817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:25.116863 14809 server_base.cc:1034] running on GCE node
I20260810 06:33:25.117321 14809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:25.118099 14809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:25.119283 14809 hybrid_clock.cc:648] HybridClock initialized: now 1786343605119258 us; error 41 us; skew 500 ppm
Aug 10 06:33:25 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343605, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:25.122328 14809 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:33:25.123365 14809 webserver.cc:460] Webserver started at http://127.21.195.193:34871/ using document root <none> and password file <none>
I20260810 06:33:25.124004 14809 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:25.124082 14809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:25.124313 14809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:25.126679 14809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "1be36dc580a04c0e91cd828b7fefb415"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "1da932721a424c6c47fd2db28a5c3c08"
server_key_iv: "cd29561508f453408545450967cfd5fb"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.127293 14809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "1be36dc580a04c0e91cd828b7fefb415"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "1da932721a424c6c47fd2db28a5c3c08"
server_key_iv: "cd29561508f453408545450967cfd5fb"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.131595 14809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:33:25.134461 14830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.135989 14809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:33:25.136134 14809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "1be36dc580a04c0e91cd828b7fefb415"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "1da932721a424c6c47fd2db28a5c3c08"
server_key_iv: "cd29561508f453408545450967cfd5fb"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.136250 14809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:25.170928 14809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:25.174185 14809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:25.174360 14809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:25.175055 14809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:25.175962 14809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:25.176012 14809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.176055 14809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:25.176075 14809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.185318 14809 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:35255
I20260810 06:33:25.185349 15012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:35255 every 8 connection(s)
I20260810 06:33:25.186460 14809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:33:25.195056 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 14809
I20260810 06:33:25.195206 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:33:25.195564 22287 external_mini_cluster.cc:1428] Setting key 37831858306866466dd70798a0761622
Aug 10 06:33:25 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343605, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:25.201690 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.188558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:47351 (local address 127.21.195.254:35219)
0810 06:33:25.188699 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.188702 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.189953 (+ 1251us) server_negotiation.cc:407] Connection header received
0810 06:33:25.190892 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.190895 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.190962 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.191052 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:25.192354 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.192920 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.194254 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.194518 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.194622 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.197600 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:25.197604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:25.197606 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:25.197633 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:25.199106 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:25.199746 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:25.199749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:25.199751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:25.199856 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:25.200269 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:25.200273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:25.200275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:25.200564 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:25.200661 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.201284 (+ 623us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.201451 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:33:25.202625 15017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.189004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:47351)
0810 06:33:25.189762 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.189812 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:25.190684 (+ 872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:25.191211 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:25.191219 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:25.191615 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:25.192167 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.192185 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.193063 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.193066 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.194095 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.194107 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.194664 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.194667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.194859 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.195569 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:25.195593 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:25.197395 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:25.199235 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:25.199243 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:25.199264 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:25.199642 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:25.199951 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:25.199954 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:25.199957 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:25.200174 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:25.200672 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:25.200681 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:25.200989 (+ 308us) client_negotiation.cc:769] Sending connection context
0810 06:33:25.201199 (+ 210us) client_negotiation.cc:240] Negotiation successful
0810 06:33:25.201595 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":135,"threads_started":1}
I20260810 06:33:25.204090 15014 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35219
I20260810 06:33:25.204429 15014 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:25.205013 15014 heartbeater.cc:511] Master 127.21.195.254:35219 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:33:25.206975 14713 ts_manager.cc:194] Registered new tserver with Master: 1be36dc580a04c0e91cd828b7fefb415 (127.21.195.193:35255)
I20260810 06:33:25.208285 14713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:47351
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:33:25.224732 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35219
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:25.347707 15021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:25.348049 15021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:25.348120 15021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:25.352372 15021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:25.352463 15021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:25.352552 15021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:33:25.358342 15021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:25.359616 15021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:25.360786 15021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:25.371318 15036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:25.371318 15033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:25.371318 15032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:25.371800 15021 server_base.cc:1034] running on GCE node
I20260810 06:33:25.372232 15021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:25.372941 15021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:25.374120 15021 hybrid_clock.cc:648] HybridClock initialized: now 1786343605374092 us; error 41 us; skew 500 ppm
Aug 10 06:33:25 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343605, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:25.377127 15021 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:33:25.378204 15021 webserver.cc:460] Webserver started at http://127.21.195.194:43061/ using document root <none> and password file <none>
I20260810 06:33:25.378823 15021 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:25.378895 15021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:25.379130 15021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:25.381407 15021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "04703131db464a1c9964de39c372cf9f"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "551548098468d68f52996624a3f8a477"
server_key_iv: "04f113c3c24347d065b1e5f102e10f37"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.382118 15021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "04703131db464a1c9964de39c372cf9f"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "551548098468d68f52996624a3f8a477"
server_key_iv: "04f113c3c24347d065b1e5f102e10f37"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.386320 15021 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:33:25.389072 15049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.390515 15021 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:25.390656 15021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "04703131db464a1c9964de39c372cf9f"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "551548098468d68f52996624a3f8a477"
server_key_iv: "04f113c3c24347d065b1e5f102e10f37"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.390786 15021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:25.428709 15021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:25.432037 15021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:25.432248 15021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:25.432934 15021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:25.433939 15021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:25.433995 15021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.434057 15021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:25.434084 15021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.443535 15021 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:45727
I20260810 06:33:25.443559 15232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:45727 every 8 connection(s)
I20260810 06:33:25.444562 15021 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:33:25.452883 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 15021
I20260810 06:33:25.453003 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:33:25.453281 22287 external_mini_cluster.cc:1428] Setting key 7f3f6223ae42fca578b34c0e89d28e5d
Aug 10 06:33:25 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343605, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:25.460757 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.446654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:39751 (local address 127.21.195.254:35219)
0810 06:33:25.446799 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.446803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.448064 (+ 1261us) server_negotiation.cc:407] Connection header received
0810 06:33:25.449038 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.449042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.449104 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.449187 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:25.450563 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.451117 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.452333 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.452599 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.452711 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.455696 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:25.455700 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:25.455703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:25.455735 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:25.458317 (+ 2582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:25.459036 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:25.459040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:25.459042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:25.459146 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:25.459509 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:25.459513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:25.459515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:25.459732 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:25.459826 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.460403 (+ 577us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.460573 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:33:25.461760 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.447136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:39751)
0810 06:33:25.447875 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.447923 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:25.448801 (+ 878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:25.449392 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:25.449401 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:25.449841 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:25.450385 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.450400 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.451255 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.451258 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.452197 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.452209 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.452793 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.452797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.452979 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.453658 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:25.453677 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:25.455479 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:25.458481 (+ 3002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:25.458488 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:25.458526 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:25.458858 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:25.459241 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:25.459245 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:25.459247 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:25.459412 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:25.459840 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:25.459849 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:25.460147 (+ 298us) client_negotiation.cc:769] Sending connection context
0810 06:33:25.460340 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 06:33:25.460721 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":131,"threads_started":1}
I20260810 06:33:25.463039 15233 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35219
I20260810 06:33:25.463320 15233 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:25.463886 15233 heartbeater.cc:511] Master 127.21.195.254:35219 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:33:25.465060 14713 ts_manager.cc:194] Registered new tserver with Master: 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727)
I20260810 06:33:25.465757 14713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:39751
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:33:25.482612 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35219
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:25.604765 15238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:25.605155 15238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:25.605211 15238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:25.609395 15238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:25.609472 15238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:25.609555 15238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:33:25.615222 15238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:25.616423 15238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:25.617494 15238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:25.627981 15247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:25.628053 15249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:25.628053 15245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:25.628257 15238 server_base.cc:1034] running on GCE node
I20260810 06:33:25.628969 15238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:25.629755 15238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:25.630926 15238 hybrid_clock.cc:648] HybridClock initialized: now 1786343605630900 us; error 41 us; skew 500 ppm
Aug 10 06:33:25 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343605, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:25.633982 15238 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:33:25.634979 15238 webserver.cc:460] Webserver started at http://127.21.195.195:40815/ using document root <none> and password file <none>
I20260810 06:33:25.635586 15238 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:25.635665 15238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:25.635895 15238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:33:25.638239 15238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "cc9080cb0e574319be20c5d14899e835"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "e2177c1b75c2cf855404bef4407a7591"
server_key_iv: "e3e338a558462eeeedb7d51a9438666a"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.638862 15238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "cc9080cb0e574319be20c5d14899e835"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "e2177c1b75c2cf855404bef4407a7591"
server_key_iv: "e3e338a558462eeeedb7d51a9438666a"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.643175 15238 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:33:25.646078 15258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.647526 15238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:25.647679 15238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "cc9080cb0e574319be20c5d14899e835"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "e2177c1b75c2cf855404bef4407a7591"
server_key_iv: "e3e338a558462eeeedb7d51a9438666a"
server_key_version: "encryptionkey@0"
I20260810 06:33:25.647799 15238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:25.664302 15238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:25.667513 15238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:25.667696 15238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:25.668318 15238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:25.669270 15238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:25.669324 15238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.669368 15238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:25.669389 15238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:25.678771 15238 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:37467
I20260810 06:33:25.678793 15432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:37467 every 8 connection(s)
I20260810 06:33:25.679850 15238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:33:25.680579 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 15238
I20260810 06:33:25.680711 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:33:25.681002 22287 external_mini_cluster.cc:1428] Setting key c83d56315fe8e5af7e2e94de6a505fbb
Aug 10 06:33:25 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343605, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:25.694038 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.681867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:43561 (local address 127.21.195.254:35219)
0810 06:33:25.682013 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.682018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.683447 (+ 1429us) server_negotiation.cc:407] Connection header received
0810 06:33:25.684391 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.684394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.684462 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.684533 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:25.685865 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.686421 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.687609 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.687837 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.687932 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.690582 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:25.690586 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:25.690588 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:25.690617 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:25.691799 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:25.692343 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:25.692347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:25.692349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:25.692439 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:25.692800 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:25.692803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:25.692805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:25.693018 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:25.693112 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.693703 (+ 591us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.693857 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:33:25.695013 15436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.682473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:43561)
0810 06:33:25.683292 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.683351 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:25.684208 (+ 857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:25.684710 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:25.684718 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:25.685126 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:25.685737 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.685757 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.686529 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.686531 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.687473 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.687483 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.688011 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.688017 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.688198 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.688759 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:25.688778 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:25.690368 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:25.691918 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:25.691925 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:25.691944 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:25.692235 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:25.692539 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:25.692542 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:25.692544 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:25.692703 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:25.693125 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:25.693133 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:25.693410 (+ 277us) client_negotiation.cc:769] Sending connection context
0810 06:33:25.693634 (+ 224us) client_negotiation.cc:240] Negotiation successful
0810 06:33:25.694023 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":135,"threads_started":1}
I20260810 06:33:25.696228 15434 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35219
I20260810 06:33:25.696504 15434 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:25.697062 15434 heartbeater.cc:511] Master 127.21.195.254:35219 requested a full tablet report, sending...
I20260810 06:33:25.698179 14713 ts_manager.cc:194] Registered new tserver with Master: cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467)
I20260810 06:33:25.698760 14713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:43561
I20260810 06:33:25.707711 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:33:25.717224 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.709842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45084 (local address 127.21.195.254:35219)
0810 06:33:25.709979 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.709984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.710171 (+ 187us) server_negotiation.cc:407] Connection header received
0810 06:33:25.710297 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.710300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.710350 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.710417 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:25.711172 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.711714 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.712566 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.712795 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.712887 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.714325 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:25.714329 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:25.714331 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:25.714361 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:25.715481 (+ 1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:25.715902 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:25.715906 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:25.715908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:25.716001 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:25.716259 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:25.716263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:25.716265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:25.716554 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:25.716704 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.716929 (+ 225us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.717058 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:33:25.720227 14713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45084:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:33:25.723654 14713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:33:25.738984 15450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.732813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:45727 (local address 127.0.0.1:55450)
0810 06:33:25.733698 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.733759 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:25.733906 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:25.734771 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:25.734778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:25.734803 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:25.734952 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.734959 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.736057 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.736061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.737309 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.737320 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.738371 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.738374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.738488 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.738531 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 06:33:25.738654 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:33:25.738805 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"spinlock_wait_cycles":1792,"thread_start_us":113,"threads_started":1}
I20260810 06:33:25.738982 15452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.733448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55450 (local address 127.21.195.194:45727)
0810 06:33:25.734211 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.734223 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.734245 (+ 22us) server_negotiation.cc:407] Connection header received
0810 06:33:25.734328 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.734334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.734598 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.734761 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:25.735101 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.735921 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.737455 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.738255 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.738372 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.738547 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.738697 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.738804 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":662,"thread_start_us":342,"threads_started":1}
I20260810 06:33:25.739511 15449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.733070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35255 (local address 127.0.0.1:47670)
0810 06:33:25.734133 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.734147 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:25.734248 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:25.734950 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:25.734953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:25.734982 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:25.735116 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.735122 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.736572 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.736576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.737862 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.737872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.739103 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.739106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.739192 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.739212 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:33:25.739282 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 06:33:25.739347 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1004,"mutex_wait_us":115,"spinlock_wait_cycles":7808,"thread_start_us":94,"threads_started":1}
I20260810 06:33:25.739631 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.733763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47670 (local address 127.21.195.193:35255)
0810 06:33:25.734123 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.734132 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.734218 (+ 86us) server_negotiation.cc:407] Connection header received
0810 06:33:25.734362 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.734367 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.734604 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.734825 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:25.735250 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.736442 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.738001 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.738769 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.738883 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.739043 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.739326 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.739440 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":88,"threads_started":1}
I20260810 06:33:25.739926 15451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.733060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41472 (local address 127.21.195.195:37467)
0810 06:33:25.734512 (+ 1452us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.734524 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.734545 (+ 21us) server_negotiation.cc:407] Connection header received
0810 06:33:25.734614 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.734619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.734787 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.735056 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:25.735255 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.736451 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.737850 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.738702 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.739464 (+ 762us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.739621 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.739677 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.739778 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1350,"thread_start_us":105,"threads_started":1}
I20260810 06:33:25.739266 15448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.732723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37467 (local address 127.0.0.1:41472)
0810 06:33:25.733698 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.733759 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:25.733906 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:25.734941 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:25.734955 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:25.734976 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:25.735142 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.735150 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.736609 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.736612 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.737720 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.737731 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.738855 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.738859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.738961 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.738985 (+ 24us) client_negotiation.cc:769] Sending connection context
0810 06:33:25.739037 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:33:25.739114 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"mutex_wait_us":116,"spinlock_wait_cycles":8320,"thread_start_us":122,"threads_started":1}
I20260810 06:33:25.743083 14912 tablet_service.cc:1467] Processing CreateTablet for tablet 8b200b5de8c849709a0f57311b0cb849 (DEFAULT_TABLE table=test-table [id=fae22477363d45f79e99d3c40948dc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:25.743083 15114 tablet_service.cc:1467] Processing CreateTablet for tablet 8b200b5de8c849709a0f57311b0cb849 (DEFAULT_TABLE table=test-table [id=fae22477363d45f79e99d3c40948dc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:25.743515 15333 tablet_service.cc:1467] Processing CreateTablet for tablet 8b200b5de8c849709a0f57311b0cb849 (DEFAULT_TABLE table=test-table [id=fae22477363d45f79e99d3c40948dc1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:25.744396 14912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b200b5de8c849709a0f57311b0cb849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:25.744396 15114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b200b5de8c849709a0f57311b0cb849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:25.744473 15333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8b200b5de8c849709a0f57311b0cb849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:25.751807 15456 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: Bootstrap starting.
I20260810 06:33:25.753279 15458 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Bootstrap starting.
I20260810 06:33:25.753279 15461 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: Bootstrap starting.
I20260810 06:33:25.754426 15456 tablet_bootstrap.cc:654] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:25.755614 15456 log.cc:824] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:25.755774 15458 tablet_bootstrap.cc:654] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:25.756188 15461 tablet_bootstrap.cc:654] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:25.756776 15458 log.cc:824] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:25.757015 15461 log.cc:824] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:25.758348 15456 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: No bootstrap required, opened a new log
I20260810 06:33:25.758602 15456 ts_tablet_manager.cc:1397] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260810 06:33:25.758898 15458 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: No bootstrap required, opened a new log
I20260810 06:33:25.759089 15458 ts_tablet_manager.cc:1397] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:33:25.759137 15461 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: No bootstrap required, opened a new log
I20260810 06:33:25.759377 15461 ts_tablet_manager.cc:1397] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:33:25.762826 15458 raft_consensus.cc:348] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.762844 15456 raft_consensus.cc:348] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.763162 15456 raft_consensus.cc:374] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:25.763266 15456 raft_consensus.cc:729] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9080cb0e574319be20c5d14899e835, State: Initialized, Role: FOLLOWER
I20260810 06:33:25.763121 15461 raft_consensus.cc:348] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.763325 15458 raft_consensus.cc:374] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:25.763459 15458 raft_consensus.cc:729] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be36dc580a04c0e91cd828b7fefb415, State: Initialized, Role: FOLLOWER
I20260810 06:33:25.763475 15461 raft_consensus.cc:374] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:25.763526 15461 raft_consensus.cc:729] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04703131db464a1c9964de39c372cf9f, State: Initialized, Role: FOLLOWER
I20260810 06:33:25.763896 15456 consensus_queue.cc:260] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.763986 15461 consensus_queue.cc:260] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.764016 15458 consensus_queue.cc:260] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.764966 15233 heartbeater.cc:503] Master 127.21.195.254:35219 was elected leader, sending a full tablet report...
I20260810 06:33:25.765115 15461 ts_tablet_manager.cc:1428] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:33:25.765117 15458 ts_tablet_manager.cc:1428] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:33:25.765218 15014 heartbeater.cc:503] Master 127.21.195.254:35219 was elected leader, sending a full tablet report...
I20260810 06:33:25.765684 15456 ts_tablet_manager.cc:1428] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260810 06:33:25.765718 15434 heartbeater.cc:503] Master 127.21.195.254:35219 was elected leader, sending a full tablet report...
I20260810 06:33:25.831410 15469 raft_consensus.cc:482] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:25.831660 15469 raft_consensus.cc:504] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.832901 15469 leader_election.cc:288] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467), 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727)
I20260810 06:33:25.836912 15452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.833273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:36085 (local address 127.21.195.194:45727)
0810 06:33:25.833409 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.833414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.833782 (+ 368us) server_negotiation.cc:407] Connection header received
0810 06:33:25.833868 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.833871 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.833920 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.833986 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:25.834283 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.834804 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.835953 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.836363 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.836478 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.836539 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.836703 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.836790 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 06:33:25.836936 15470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.833199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:45727 (local address 127.21.195.193:36085)
0810 06:33:25.833663 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.833675 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:25.833782 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:25.834003 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:25.834006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:25.834021 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:25.834170 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.834175 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.834907 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.834910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.835823 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.835833 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.836478 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.836481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.836578 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.836605 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 06:33:25.836672 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 06:33:25.836751 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":54,"spinlock_wait_cycles":31616,"thread_start_us":105,"threads_started":1}
I20260810 06:33:25.836916 15451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.833286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:48919 (local address 127.21.195.195:37467)
0810 06:33:25.833409 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.833414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.833735 (+ 321us) server_negotiation.cc:407] Connection header received
0810 06:33:25.833874 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.833876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.833921 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.833992 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:25.834289 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.834787 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.835953 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.836366 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.836480 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.836540 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.836726 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.836805 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 06:33:25.836941 15471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.833199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37467 (local address 127.21.195.193:48919)
0810 06:33:25.833631 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.833644 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:25.833764 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:25.834009 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:25.834011 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:25.834037 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:25.834178 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.834183 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.834896 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.834899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.835823 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:25.835833 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.836487 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.836490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:25.836608 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.836630 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 06:33:25.836694 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 06:33:25.836767 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":40,"spinlock_wait_cycles":896,"thread_start_us":161,"threads_started":1}
I20260810 06:33:25.837850 15150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b200b5de8c849709a0f57311b0cb849" candidate_uuid: "1be36dc580a04c0e91cd828b7fefb415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04703131db464a1c9964de39c372cf9f" is_pre_election: true
I20260810 06:33:25.838079 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b200b5de8c849709a0f57311b0cb849" candidate_uuid: "1be36dc580a04c0e91cd828b7fefb415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9080cb0e574319be20c5d14899e835" is_pre_election: true
I20260810 06:33:25.838195 15150 raft_consensus.cc:2454] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be36dc580a04c0e91cd828b7fefb415 in term 0.
I20260810 06:33:25.838372 15362 raft_consensus.cc:2454] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1be36dc580a04c0e91cd828b7fefb415 in term 0.
I20260810 06:33:25.838723 14832 leader_election.cc:302] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04703131db464a1c9964de39c372cf9f, 1be36dc580a04c0e91cd828b7fefb415; no voters:
I20260810 06:33:25.839007 15469 raft_consensus.cc:2781] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:33:25.839102 15469 raft_consensus.cc:482] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:33:25.839151 15469 raft_consensus.cc:3037] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:25.840246 15469 raft_consensus.cc:504] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.840632 15469 leader_election.cc:288] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 1 election: Requested vote from peers cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467), 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727)
I20260810 06:33:25.841023 15150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b200b5de8c849709a0f57311b0cb849" candidate_uuid: "1be36dc580a04c0e91cd828b7fefb415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04703131db464a1c9964de39c372cf9f"
I20260810 06:33:25.841023 15362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b200b5de8c849709a0f57311b0cb849" candidate_uuid: "1be36dc580a04c0e91cd828b7fefb415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9080cb0e574319be20c5d14899e835"
I20260810 06:33:25.841147 15150 raft_consensus.cc:3037] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:25.841152 15362 raft_consensus.cc:3037] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:25.842312 15150 raft_consensus.cc:2454] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be36dc580a04c0e91cd828b7fefb415 in term 1.
I20260810 06:33:25.842320 15362 raft_consensus.cc:2454] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1be36dc580a04c0e91cd828b7fefb415 in term 1.
I20260810 06:33:25.842624 14832 leader_election.cc:302] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04703131db464a1c9964de39c372cf9f, 1be36dc580a04c0e91cd828b7fefb415; no voters:
I20260810 06:33:25.842836 15469 raft_consensus.cc:2781] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:33:25.843087 15469 raft_consensus.cc:686] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 1 LEADER]: Becoming Leader. State: Replica: 1be36dc580a04c0e91cd828b7fefb415, State: Running, Role: LEADER
I20260810 06:33:25.843467 15469 consensus_queue.cc:237] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:25.846992 14709 catalog_manager.cc:5495] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1be36dc580a04c0e91cd828b7fefb415 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "1be36dc580a04c0e91cd828b7fefb415" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260810 06:33:25.864504 15453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.860747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47676 (local address 127.21.195.193:35255)
0810 06:33:25.860904 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:25.860909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:25.860925 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:33:25.861023 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:25.861025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:25.861084 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:25.861182 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:33:25.861447 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.862035 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.862923 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:25.863154 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:25.863248 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:25.863598 (+ 350us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:33:25.864100 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:33:25.864220 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:25.864279 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 06:33:25.864349 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 06:33:25.871323 15150 raft_consensus.cc:1261] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 1 FOLLOWER]: Refusing update from remote peer 1be36dc580a04c0e91cd828b7fefb415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:25.871323 15362 raft_consensus.cc:1261] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 1 FOLLOWER]: Refusing update from remote peer 1be36dc580a04c0e91cd828b7fefb415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:25.872161 15469 consensus_queue.cc:1035] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:25.872400 15474 consensus_queue.cc:1035] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:25.881050 15481 mvcc.cc:205] Tried to move back new op lower bound from 7316863409640194048 to 7316863409538002944. Current Snapshot: MvccSnapshot[applied={T|T < 7316863409640194048}]
I20260810 06:33:25.883387 15482 mvcc.cc:205] Tried to move back new op lower bound from 7316863409640194048 to 7316863409538002944. Current Snapshot: MvccSnapshot[applied={T|T < 7316863409640194048}]
I20260810 06:33:25.884780 15483 mvcc.cc:205] Tried to move back new op lower bound from 7316863409640194048 to 7316863409538002944. Current Snapshot: MvccSnapshot[applied={T|T < 7316863409640194048}]
I20260810 06:33:25.895464 14709 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45084:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:33:25.895720 14709 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45084:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:33:25.898816 14709 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Sending DeleteTablet for 3 replicas of tablet 8b200b5de8c849709a0f57311b0cb849
I20260810 06:33:25.899811 15333 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b200b5de8c849709a0f57311b0cb849 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:25 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:41472
I20260810 06:33:25.899811 15114 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b200b5de8c849709a0f57311b0cb849 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:25 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:55450
I20260810 06:33:25.900058 14912 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b200b5de8c849709a0f57311b0cb849 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:25 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:47670
I20260810 06:33:25.900593 15503 tablet_replica.cc:330] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: stopping tablet replica
I20260810 06:33:25.900591 15495 tablet_replica.cc:330] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: stopping tablet replica
I20260810 06:33:25.901031 15503 raft_consensus.cc:2229] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:33:25.901026 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 14809
I20260810 06:33:25.901084 15494 tablet_replica.cc:330] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: stopping tablet replica
I20260810 06:33:25.901425 15494 raft_consensus.cc:2229] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:33:25.901722 15495 raft_consensus.cc:2229] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:33:25.902064 15495 raft_consensus.cc:2258] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:25.902480 15494 raft_consensus.cc:2258] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:25.914381 15494 ts_tablet_manager.cc:1905] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:25.915730 15495 ts_tablet_manager.cc:1905] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:25.918263 15494 ts_tablet_manager.cc:1918] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:25.918691 15495 ts_tablet_manager.cc:1918] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:25.918871 15495 log.cc:1196] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/8b200b5de8c849709a0f57311b0cb849
I20260810 06:33:25.919217 15495 ts_tablet_manager.cc:1939] T 8b200b5de8c849709a0f57311b0cb849 P cc9080cb0e574319be20c5d14899e835: Deleting consensus metadata
I20260810 06:33:25.919507 15494 log.cc:1196] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/8b200b5de8c849709a0f57311b0cb849
I20260810 06:33:25.919963 15494 ts_tablet_manager.cc:1939] T 8b200b5de8c849709a0f57311b0cb849 P 04703131db464a1c9964de39c372cf9f: Deleting consensus metadata
I20260810 06:33:25.920930 14687 catalog_manager.cc:4841] TS cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467): tablet 8b200b5de8c849709a0f57311b0cb849 (table test-table [id=fae22477363d45f79e99d3c40948dc1c]) successfully deleted
I20260810 06:33:25.921316 14688 catalog_manager.cc:4841] TS 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727): tablet 8b200b5de8c849709a0f57311b0cb849 (table test-table [id=fae22477363d45f79e99d3c40948dc1c]) successfully deleted
W20260810 06:33:25.934755 14690 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:35255 (error 108)
I20260810 06:33:25.934981 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 15021
I20260810 06:33:25.945407 15450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:25.945020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35255 (local address 127.0.0.1:47686)
0810 06:33:25.945224 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:25.945304 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260810 06:33:25.945814 14690 catalog_manager.cc:4584] TS 1be36dc580a04c0e91cd828b7fefb415 (127.21.195.193:35255): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8b200b5de8c849709a0f57311b0cb849: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35255: connect: Connection refused (error 111)
I20260810 06:33:25.952708 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 15238
I20260810 06:33:25.971822 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 14661
I20260810 06:33:45.997852 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35219
--webserver_interface=127.21.195.254
--webserver_port=44405
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:35219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:33:46.120507 15505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:46.120841 15505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:46.120883 15505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:46.125434 15505 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 06:33:46.125566 15505 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 06:33:46.125618 15505 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 06:33:46.125646 15505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:33:46.125676 15505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:46.125712 15505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:46.125743 15505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:33:46.125774 15505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:33:46.131675 15505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:35219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=44405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:46.132977 15505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:46.134298 15505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:46.149945 15521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:46.150054 15505 server_base.cc:1034] running on GCE node
W20260810 06:33:46.149946 15516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:46.149945 15515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:46.150914 15505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:46.152248 15505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:46.153414 15505 hybrid_clock.cc:648] HybridClock initialized: now 1786343626153398 us; error 54 us; skew 500 ppm
Aug 10 06:33:46 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:46.157058 15505 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:33:46.158218 15505 webserver.cc:460] Webserver started at http://127.21.195.254:44405/ using document root <none> and password file <none>
I20260810 06:33:46.158866 15505 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:46.158977 15505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:46.163589 15505 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260810 06:33:46.166298 15534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:46.167798 15505 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:46.167961 15505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "391e2c3ed85e43ad9abea4958f852cc9"
format_stamp: "Formatted at 2026-08-10 06:33:24 on dist-test-slave-7lbf"
server_key: "06495000d34ae740e017a777dabaff3e"
server_key_iv: "bacc8e2418b4ab041bcf64ecc0ad6200"
server_key_version: "encryptionkey@0"
I20260810 06:33:46.168670 15505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:46.185062 15505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:46.188820 15505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:46.189052 15505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:46.196882 15505 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:35219
I20260810 06:33:46.197175 15616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:35219 every 8 connection(s)
I20260810 06:33:46.198228 15505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:33:46.203435 15618 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:33:46.205457 15618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Bootstrap starting.
I20260810 06:33:46.206669 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 15505
I20260810 06:33:46.207214 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:35255
--local_ip_for_outbound_sockets=127.21.195.193
--tserver_master_addrs=127.21.195.254:35219
--webserver_port=34871
--webserver_interface=127.21.195.193
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:46.224565 15618 log.cc:824] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:46.234831 15618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:33:46.235247 15618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Bootstrap complete.
I20260810 06:33:46.239569 15618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:33:46.240073 15618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391e2c3ed85e43ad9abea4958f852cc9, State: Initialized, Role: FOLLOWER
I20260810 06:33:46.240628 15618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:33:46.240764 15618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:33:46.240846 15618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:33:46.240948 15618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 1 FOLLOWER]: Advancing to term 2
I20260810 06:33:46.243271 15618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:33:46.243660 15618 leader_election.cc:302] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 391e2c3ed85e43ad9abea4958f852cc9; no voters:
I20260810 06:33:46.244029 15618 leader_election.cc:288] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 06:33:46.244143 15623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 06:33:46.244329 15623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 2 LEADER]: Becoming Leader. State: Replica: 391e2c3ed85e43ad9abea4958f852cc9, State: Running, Role: LEADER
I20260810 06:33:46.244659 15623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:33:46.245452 15618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:33:46.246325 15624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "391e2c3ed85e43ad9abea4958f852cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } } }
I20260810 06:33:46.246356 15625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 391e2c3ed85e43ad9abea4958f852cc9. Latest consensus state: current_term: 2 leader_uuid: "391e2c3ed85e43ad9abea4958f852cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } } }
I20260810 06:33:46.246469 15624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:46.246470 15625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: This master's current role is: LEADER
I20260810 06:33:46.250995 15648 catalog_manager.cc:1259] Loaded cluster ID: e0b062498031457ba7e93550834811e4
I20260810 06:33:46.251068 15648 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: loading cluster ID for follower catalog manager: success
I20260810 06:33:46.252990 15648 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: acquiring CA information for follower catalog manager: success
I20260810 06:33:46.254412 15648 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:33:46.254592 15636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:33:46.256736 15636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:33:46.257225 15636 catalog_manager.cc:1259] Loaded cluster ID: e0b062498031457ba7e93550834811e4
I20260810 06:33:46.257284 15636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:33:46.257936 15636 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:33:46.258355 15636 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Loaded TSK: 0
I20260810 06:33:46.274115 15636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Generated new TSK 1
I20260810 06:33:46.274446 15636 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:33:46.345016 15620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:46.345361 15620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:46.345427 15620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:46.350019 15620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:46.350111 15620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:46.350198 15620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:33:46.355957 15620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:35255
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=34871
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:46.357226 15620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:46.358466 15620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:46.369316 15663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:46.369346 15660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:46.369316 15666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:46.369966 15620 server_base.cc:1034] running on GCE node
I20260810 06:33:46.370421 15620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:46.371191 15620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:46.372368 15620 hybrid_clock.cc:648] HybridClock initialized: now 1786343626372317 us; error 69 us; skew 500 ppm
Aug 10 06:33:46 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:46.375692 15620 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:33:46.376775 15620 webserver.cc:460] Webserver started at http://127.21.195.193:34871/ using document root <none> and password file <none>
I20260810 06:33:46.377411 15620 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:46.377547 15620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:46.382268 15620 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260810 06:33:46.384929 15679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:46.386492 15620 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:33:46.386643 15620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "1be36dc580a04c0e91cd828b7fefb415"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "1da932721a424c6c47fd2db28a5c3c08"
server_key_iv: "cd29561508f453408545450967cfd5fb"
server_key_version: "encryptionkey@0"
I20260810 06:33:46.387275 15620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:46.404121 15620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:46.407851 15620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:46.408061 15620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:46.408831 15620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:46.410143 15688 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 06:33:46.414892 15620 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 06:33:46.415007 15620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260810 06:33:46.415096 15620 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 06:33:46.417128 15620 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 06:33:46.417189 15620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 06:33:46.417557 15688 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Bootstrap starting.
I20260810 06:33:46.427446 15620 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:35255
I20260810 06:33:46.427515 15865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:35255 every 8 connection(s)
I20260810 06:33:46.428547 15620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:33:46.436777 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 15620
I20260810 06:33:46.437229 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:45727
--local_ip_for_outbound_sockets=127.21.195.194
--tserver_master_addrs=127.21.195.254:35219
--webserver_port=43061
--webserver_interface=127.21.195.194
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:33:46.437357 15688 log.cc:824] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:33:46 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:46.447566 15688 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:33:46.447896 15871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.430827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:33085)
0810 06:33:46.431373 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:46.431432 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:46.432337 (+ 905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:46.434024 (+ 1687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:46.434032 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:46.434435 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:46.434972 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.435003 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.436975 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.436979 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.438253 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.438266 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.439320 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.439324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.439548 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.440291 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:46.440315 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:46.441986 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:46.444149 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:46.444155 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:46.444171 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:46.444441 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:46.444848 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:46.444851 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:46.444853 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:46.445067 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:46.445814 (+ 747us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:46.445820 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:46.446090 (+ 270us) client_negotiation.cc:769] Sending connection context
0810 06:33:46.446334 (+ 244us) client_negotiation.cc:240] Negotiation successful
0810 06:33:46.446782 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":141,"threads_started":1}
I20260810 06:33:46.447877 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.430864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:33085 (local address 127.21.195.254:35219)
0810 06:33:46.431484 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.431504 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.431562 (+ 58us) server_negotiation.cc:407] Connection header received
0810 06:33:46.432865 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.432884 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.433466 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.433978 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:46.435198 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.436765 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.438400 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.439150 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.439345 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.442224 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:46.442230 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:46.442245 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:46.442278 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:46.444028 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.444572 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.444578 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.444583 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.444744 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.445179 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.445183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.445185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.445694 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:46.445830 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.446508 (+ 678us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.446896 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":170,"threads_started":1}
I20260810 06:33:46.448062 15688 tablet_bootstrap.cc:492] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Bootstrap complete.
I20260810 06:33:46.449995 15688 ts_tablet_manager.cc:1397] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.018s
I20260810 06:33:46.451112 15866 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35219
I20260810 06:33:46.451360 15866 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:46.451896 15866 heartbeater.cc:511] Master 127.21.195.254:35219 requested a full tablet report, sending...
I20260810 06:33:46.453392 15688 raft_consensus.cc:348] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.454015 15688 raft_consensus.cc:729] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be36dc580a04c0e91cd828b7fefb415, State: Initialized, Role: FOLLOWER
I20260810 06:33:46.454566 15688 consensus_queue.cc:260] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.454659 15562 ts_manager.cc:194] Registered new tserver with Master: 1be36dc580a04c0e91cd828b7fefb415 (127.21.195.193:35255)
I20260810 06:33:46.455695 15688 ts_tablet_manager.cc:1428] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260810 06:33:46.458526 15562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:33085
I20260810 06:33:46.461726 15866 heartbeater.cc:503] Master 127.21.195.254:35219 was elected leader, sending a full tablet report...
Aug 10 06:33:46 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.193@KRBTEST.COM
I20260810 06:33:46.469686 15877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.457864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35255 (local address 127.0.0.1:40680)
0810 06:33:46.458334 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:46.458401 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:46.458552 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:46.459552 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:46.459559 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:46.459955 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:46.460084 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.460092 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.461644 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.461648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.462528 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.462540 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.463206 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.463210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.463339 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.464053 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:46.464065 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:46.465810 (+ 1745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:46.467872 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:46.467882 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:46.467888 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:46.468154 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:46.468479 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:46.468482 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:46.468484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:46.468561 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:46.469079 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:46.469083 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:46.469200 (+ 117us) client_negotiation.cc:769] Sending connection context
0810 06:33:46.469316 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 06:33:46.469501 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":129,"threads_started":1}
I20260810 06:33:46.469815 15881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.458619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40680 (local address 127.21.195.193:35255)
0810 06:33:46.458977 (+ 358us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.458989 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.459014 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:33:46.459090 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.459095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.459324 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.459550 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:46.460206 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.461458 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.462651 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.463079 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.463189 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.465963 (+ 2774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:46.465974 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:46.465990 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:46.466021 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:46.467759 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.468267 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.468273 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.468275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.468393 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.468634 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.468636 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.468638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.468977 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:46.469117 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.469425 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.469647 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":138,"threads_started":1}
I20260810 06:33:46.470948 15754 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b200b5de8c849709a0f57311b0cb849 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:25 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:40680
I20260810 06:33:46.471861 15882 tablet_replica.cc:330] stopping tablet replica
I20260810 06:33:46.472208 15882 raft_consensus.cc:2229] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:33:46.472510 15882 raft_consensus.cc:2258] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:46.473678 15882 ts_tablet_manager.cc:1905] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:46.477661 15882 ts_tablet_manager.cc:1918] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:46.477773 15882 log.cc:1196] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal/wals/8b200b5de8c849709a0f57311b0cb849
I20260810 06:33:46.478037 15882 ts_tablet_manager.cc:1939] T 8b200b5de8c849709a0f57311b0cb849 P 1be36dc580a04c0e91cd828b7fefb415: Deleting consensus metadata
I20260810 06:33:46.479913 15539 catalog_manager.cc:4841] TS 1be36dc580a04c0e91cd828b7fefb415 (127.21.195.193:35255): tablet 8b200b5de8c849709a0f57311b0cb849 (table test-table [id=fae22477363d45f79e99d3c40948dc1c]) successfully deleted
W20260810 06:33:46.571762 15875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:46.572120 15875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:46.572171 15875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:46.576538 15875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:46.576619 15875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:46.576701 15875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:33:46.582471 15875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:45727
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=43061
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:46.583747 15875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:46.584926 15875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:46.595990 15894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:46.595997 15890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:46.595990 15889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:46.596261 15875 server_base.cc:1034] running on GCE node
I20260810 06:33:46.596988 15875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:46.597743 15875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:46.598912 15875 hybrid_clock.cc:648] HybridClock initialized: now 1786343626598891 us; error 41 us; skew 500 ppm
Aug 10 06:33:46 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:46.601919 15875 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:33:46.602933 15875 webserver.cc:460] Webserver started at http://127.21.195.194:43061/ using document root <none> and password file <none>
I20260810 06:33:46.603549 15875 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:46.603646 15875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:46.608161 15875 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:33:46.610749 15906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:46.612228 15875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:33:46.612370 15875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "04703131db464a1c9964de39c372cf9f"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "551548098468d68f52996624a3f8a477"
server_key_iv: "04f113c3c24347d065b1e5f102e10f37"
server_key_version: "encryptionkey@0"
I20260810 06:33:46.613026 15875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:46.630067 15875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:46.633781 15875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:46.634004 15875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:46.634682 15875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:46.635639 15875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:46.635694 15875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:46.635752 15875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:46.635779 15875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:46.645109 15875 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:45727
I20260810 06:33:46.645136 16076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:45727 every 8 connection(s)
I20260810 06:33:46.646442 15875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:33:46.647452 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 15875
I20260810 06:33:46.647874 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:37467
--local_ip_for_outbound_sockets=127.21.195.195
--tserver_master_addrs=127.21.195.254:35219
--webserver_port=40815
--webserver_interface=127.21.195.195
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 06:33:46 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:46.661631 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.648595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:44035 (local address 127.21.195.254:35219)
0810 06:33:46.648765 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.648770 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.650082 (+ 1312us) server_negotiation.cc:407] Connection header received
0810 06:33:46.651082 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.651085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.651154 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.651237 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:46.652617 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.653179 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.654505 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.654755 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.654858 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.657779 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:46.657782 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:46.657784 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:46.657815 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:46.659239 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.659824 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.659827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.659829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.659922 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.660300 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.660303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.660304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.660533 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:46.660630 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.661225 (+ 595us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.661395 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:33:46.662550 16079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.649048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:44035)
0810 06:33:46.649913 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:46.649964 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:46.650847 (+ 883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:46.651473 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:46.651489 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:46.651888 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:46.652433 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.652448 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.653326 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.653330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.654357 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.654369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.654922 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.654927 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.655118 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.655759 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:46.655778 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:46.657576 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:46.659371 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:46.659378 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:46.659400 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:46.659702 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:46.660023 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:46.660026 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:46.660028 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:46.660192 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:46.660645 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:46.660654 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:46.660941 (+ 287us) client_negotiation.cc:769] Sending connection context
0810 06:33:46.661137 (+ 196us) client_negotiation.cc:240] Negotiation successful
0810 06:33:46.661552 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":113,"threads_started":1}
I20260810 06:33:46.664045 16077 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35219
I20260810 06:33:46.664325 16077 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:46.664894 16077 heartbeater.cc:511] Master 127.21.195.254:35219 requested a full tablet report, sending...
I20260810 06:33:46.666177 15562 ts_manager.cc:194] Registered new tserver with Master: 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727)
I20260810 06:33:46.667032 15562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:44035
W20260810 06:33:46.773483 16081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:33:46.773819 16081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:33:46.773874 16081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:33:46.778098 16081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:33:46.778182 16081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:33:46.778247 16081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:33:46.783891 16081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:37467
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=40815
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:33:46.785099 16081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:33:46.786469 16081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:33:46.798084 16086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:46.798084 16091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:33:46.798084 16088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:33:46.798130 16081 server_base.cc:1034] running on GCE node
I20260810 06:33:46.798913 16081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:33:46.799615 16081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:33:46.800798 16081 hybrid_clock.cc:648] HybridClock initialized: now 1786343626800773 us; error 35 us; skew 500 ppm
Aug 10 06:33:46 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:33:46.803753 16081 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:33:46.804772 16081 webserver.cc:460] Webserver started at http://127.21.195.195:40815/ using document root <none> and password file <none>
I20260810 06:33:46.805429 16081 fs_manager.cc:359] Metadata directory not provided
I20260810 06:33:46.805549 16081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:33:46.810047 16081 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260810 06:33:46.812479 16108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:46.813901 16081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260810 06:33:46.814030 16081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "cc9080cb0e574319be20c5d14899e835"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "e2177c1b75c2cf855404bef4407a7591"
server_key_iv: "e3e338a558462eeeedb7d51a9438666a"
server_key_version: "encryptionkey@0"
I20260810 06:33:46.814646 16081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:33:46.825693 16081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:33:46.828956 16081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:33:46.829172 16081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:33:46.829896 16081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:33:46.830929 16081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:33:46.830982 16081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:46.831043 16081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:33:46.831072 16081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:33:46.840274 16081 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:37467
I20260810 06:33:46.840303 16287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:37467 every 8 connection(s)
I20260810 06:33:46.841439 16081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:33:46.846012 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 16081
Aug 10 06:33:46 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:33:46.856010 16291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.846776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57710 (local address 127.21.195.254:35219)
0810 06:33:46.847002 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.847006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.847189 (+ 183us) server_negotiation.cc:407] Connection header received
0810 06:33:46.847299 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.847302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.847355 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.847433 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:46.848372 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.849101 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.850025 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.850321 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.850424 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.851864 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:46.851867 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:46.851869 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:46.851915 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:46.854014 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.854560 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.854563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.854564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.854641 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.854980 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.854984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.854986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.855214 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:46.855447 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.855651 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.855796 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":149,"thread_start_us":67,"threads_started":1}
I20260810 06:33:46.856835 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.843526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:36385 (local address 127.21.195.254:35219)
0810 06:33:46.843680 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.843684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.844901 (+ 1217us) server_negotiation.cc:407] Connection header received
0810 06:33:46.845985 (+ 1084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.845989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.846044 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.846151 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:46.847673 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.848456 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.849904 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.850237 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.850316 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.852948 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:46.852951 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:46.852953 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:46.852995 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:46.854670 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.855218 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.855221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.855223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.855299 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.855638 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.855641 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.855643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.855820 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:46.855904 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.856546 (+ 642us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.856682 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":54}
I20260810 06:33:46.857905 16290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.844026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:36385)
0810 06:33:46.844725 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:46.844771 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:46.845695 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:46.846380 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:46.846392 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:46.846967 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:33:46.847537 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.847557 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.848585 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.848588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.849771 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.849782 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.850423 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.850428 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.850646 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.851219 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:33:46.851236 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:33:46.852749 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:33:46.854786 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:46.854792 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:46.854809 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:46.855114 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:46.855386 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:33:46.855389 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:33:46.855391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:33:46.855546 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:33:46.855931 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:33:46.855939 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:33:46.856273 (+ 334us) client_negotiation.cc:769] Sending connection context
0810 06:33:46.856491 (+ 218us) client_negotiation.cc:240] Negotiation successful
0810 06:33:46.856920 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":124,"threads_started":1}
I20260810 06:33:46.859134 16288 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35219
I20260810 06:33:46.859438 16288 heartbeater.cc:464] Registering TS with master...
I20260810 06:33:46.860006 16288 heartbeater.cc:511] Master 127.21.195.254:35219 requested a full tablet report, sending...
I20260810 06:33:46.861238 15562 ts_manager.cc:194] Registered new tserver with Master: cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467)
I20260810 06:33:46.861922 15562 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:36385
I20260810 06:33:46.870695 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:33:46.875531 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.871431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57718 (local address 127.21.195.254:35219)
0810 06:33:46.871583 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.871588 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.871804 (+ 216us) server_negotiation.cc:407] Connection header received
0810 06:33:46.872027 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.872030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.872157 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.872272 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:33:46.872575 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.873126 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.874140 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.874380 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.874482 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.874873 (+ 391us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:33:46.875051 (+ 178us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 06:33:46.875364 (+ 313us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57718: token expired
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 06:33:46.875634 15873 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57718: token expired
W20260810 06:33:46.875989 15440 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.195.254:35219)
I20260810 06:33:46.883106 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.876424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57734 (local address 127.21.195.254:35219)
0810 06:33:46.876544 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.876547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.876560 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:33:46.876635 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.876637 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.876680 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.876745 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:33:46.877408 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.877958 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.878739 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.878954 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.879020 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.880287 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:33:46.880290 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:33:46.880292 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:33:46.880317 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:33:46.881810 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.882172 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.882174 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.882176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.882249 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:33:46.882430 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:33:46.882432 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:33:46.882434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:33:46.882607 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:33:46.882708 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.882871 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.882976 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 06:33:46.885939 15562 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57734:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:33:46.889695 15562 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:33:46.899004 15754 tablet_service.cc:1467] Processing CreateTablet for tablet 93f895d05d5f4ae48bc94e3795bfecfe (DEFAULT_TABLE table=test-table [id=d4088f456a5f4527bc1c9fdb6768652a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:46.899677 15754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f895d05d5f4ae48bc94e3795bfecfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:46.902823 15688 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Bootstrap starting.
I20260810 06:33:46.902995 15877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.897477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:45727 (local address 127.0.0.1:49036)
0810 06:33:46.897637 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:46.897653 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:46.897740 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:46.898677 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:46.898680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:46.898701 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:46.898819 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.898826 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.900218 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.900222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.901476 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.901488 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.902525 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.902528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.902625 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.902676 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 06:33:46.902752 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 06:33:46.902839 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":30}
I20260810 06:33:46.903023 16299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.897697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49036 (local address 127.21.195.194:45727)
0810 06:33:46.898060 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.898073 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.898101 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:33:46.898195 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.898202 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.898501 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.898690 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:46.898927 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.900094 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.901641 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.902402 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.902526 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.902689 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.902785 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.902892 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":149,"threads_started":1}
I20260810 06:33:46.903678 15688 tablet_bootstrap.cc:654] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:46.905296 15688 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: No bootstrap required, opened a new log
I20260810 06:33:46.905409 15688 ts_tablet_manager.cc:1397] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260810 06:33:46.905925 15688 raft_consensus.cc:348] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.906062 15688 raft_consensus.cc:374] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:46.906103 15688 raft_consensus.cc:729] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be36dc580a04c0e91cd828b7fefb415, State: Initialized, Role: FOLLOWER
I20260810 06:33:46.906240 15688 consensus_queue.cc:260] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.906517 15688 ts_tablet_manager.cc:1428] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 06:33:46.906849 15989 tablet_service.cc:1467] Processing CreateTablet for tablet 93f895d05d5f4ae48bc94e3795bfecfe (DEFAULT_TABLE table=test-table [id=d4088f456a5f4527bc1c9fdb6768652a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:46.907464 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.897979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37467 (local address 127.0.0.1:46286)
0810 06:33:46.898426 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:46.898440 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:46.898521 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:46.899309 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:46.899312 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:46.899331 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:46.899444 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.899450 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.900766 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.900769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.901937 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.901949 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.907005 (+ 5056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.907009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.907128 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.907159 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 06:33:46.907211 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:33:46.907307 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":1,"thread_start_us":109,"threads_started":1}
I20260810 06:33:46.908145 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.898192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46286 (local address 127.21.195.195:37467)
0810 06:33:46.898793 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.898804 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.898829 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:33:46.898912 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.898918 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.899145 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.899601 (+ 456us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:46.899791 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.900647 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.902084 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.906836 (+ 4752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.907679 (+ 843us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.907833 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.907893 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.907999 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":183,"threads_started":1}
I20260810 06:33:46.908358 15989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f895d05d5f4ae48bc94e3795bfecfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:46.911147 16185 tablet_service.cc:1467] Processing CreateTablet for tablet 93f895d05d5f4ae48bc94e3795bfecfe (DEFAULT_TABLE table=test-table [id=d4088f456a5f4527bc1c9fdb6768652a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:33:46.912221 16185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93f895d05d5f4ae48bc94e3795bfecfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:33:46.916282 16304 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: Bootstrap starting.
I20260810 06:33:46.919180 16304 tablet_bootstrap.cc:654] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:46.920053 16304 log.cc:824] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:46.920104 16306 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: Bootstrap starting.
I20260810 06:33:46.922572 16304 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: No bootstrap required, opened a new log
I20260810 06:33:46.922827 16304 ts_tablet_manager.cc:1397] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 06:33:46.923019 16306 tablet_bootstrap.cc:654] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: Neither blocks nor log segments found. Creating new log.
I20260810 06:33:46.923974 16306 log.cc:824] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: Log is configured to *not* fsync() on all Append() calls
I20260810 06:33:46.926380 16306 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: No bootstrap required, opened a new log
I20260810 06:33:46.926635 16306 ts_tablet_manager.cc:1397] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260810 06:33:46.926925 16304 raft_consensus.cc:348] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.927265 16304 raft_consensus.cc:374] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:46.927338 16304 raft_consensus.cc:729] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04703131db464a1c9964de39c372cf9f, State: Initialized, Role: FOLLOWER
I20260810 06:33:46.927868 16304 consensus_queue.cc:260] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.928656 16077 heartbeater.cc:503] Master 127.21.195.254:35219 was elected leader, sending a full tablet report...
I20260810 06:33:46.929080 16304 ts_tablet_manager.cc:1428] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260810 06:33:46.929874 15870 tablet.cc:2369] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:33:46.930613 16306 raft_consensus.cc:348] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.930889 16306 raft_consensus.cc:374] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:33:46.930964 16306 raft_consensus.cc:729] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9080cb0e574319be20c5d14899e835, State: Initialized, Role: FOLLOWER
I20260810 06:33:46.931432 16306 consensus_queue.cc:260] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.932157 16288 heartbeater.cc:503] Master 127.21.195.254:35219 was elected leader, sending a full tablet report...
I20260810 06:33:46.932548 16306 ts_tablet_manager.cc:1428] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260810 06:33:46.935704 16311 raft_consensus.cc:482] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:33:46.935884 16311 raft_consensus.cc:504] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.936961 16311 leader_election.cc:288] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727), 1be36dc580a04c0e91cd828b7fefb415 (127.21.195.193:35255)
I20260810 06:33:46.941296 16290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.937166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:45727 (local address 127.21.195.195:38263)
0810 06:33:46.937286 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:46.937303 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:46.937391 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:46.937677 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:46.937680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:46.937701 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:46.937829 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.937835 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.938832 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.938835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.940069 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.940080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.940895 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.940898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.940992 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.941012 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:33:46.941073 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 06:33:46.941153 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 06:33:46.941310 16299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.937271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:38263 (local address 127.21.195.194:45727)
0810 06:33:46.937408 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.937413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.937432 (+ 19us) server_negotiation.cc:407] Connection header received
0810 06:33:46.937489 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.937491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.937578 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.937665 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:46.937941 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.938679 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.940187 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.940759 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.940907 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.940965 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.941109 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.941188 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:33:46.941545 16312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.937194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35255 (local address 127.21.195.195:57585)
0810 06:33:46.937702 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:46.937714 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:33:46.937804 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:33:46.938082 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:33:46.938084 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:33:46.938098 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:33:46.938181 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.938185 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.939075 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.939102 (+ 27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.940232 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:33:46.940240 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.941143 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.941146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:33:46.941234 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.941255 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 06:33:46.941322 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 06:33:46.941388 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":123,"thread_start_us":178,"threads_started":1}
I20260810 06:33:46.941609 15881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.937395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:57585 (local address 127.21.195.193:35255)
0810 06:33:46.937564 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.937569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.937782 (+ 213us) server_negotiation.cc:407] Connection header received
0810 06:33:46.937895 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.937898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.937969 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.938070 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:33:46.938274 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.938962 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.940362 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.941024 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.941144 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.941319 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.941371 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.941453 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:33:46.942225 15787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93f895d05d5f4ae48bc94e3795bfecfe" candidate_uuid: "cc9080cb0e574319be20c5d14899e835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be36dc580a04c0e91cd828b7fefb415" is_pre_election: true
I20260810 06:33:46.942566 15787 raft_consensus.cc:2454] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9080cb0e574319be20c5d14899e835 in term 0.
I20260810 06:33:46.943053 16115 leader_election.cc:302] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1be36dc580a04c0e91cd828b7fefb415, cc9080cb0e574319be20c5d14899e835; no voters:
I20260810 06:33:46.943077 16017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93f895d05d5f4ae48bc94e3795bfecfe" candidate_uuid: "cc9080cb0e574319be20c5d14899e835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04703131db464a1c9964de39c372cf9f" is_pre_election: true
I20260810 06:33:46.943375 16017 raft_consensus.cc:2454] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9080cb0e574319be20c5d14899e835 in term 0.
I20260810 06:33:46.943365 16311 raft_consensus.cc:2781] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:33:46.943461 16311 raft_consensus.cc:482] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:33:46.943516 16311 raft_consensus.cc:3037] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:46.944669 16311 raft_consensus.cc:504] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.945005 16311 leader_election.cc:288] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [CANDIDATE]: Term 1 election: Requested vote from peers 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727), 1be36dc580a04c0e91cd828b7fefb415 (127.21.195.193:35255)
I20260810 06:33:46.945434 16017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93f895d05d5f4ae48bc94e3795bfecfe" candidate_uuid: "cc9080cb0e574319be20c5d14899e835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04703131db464a1c9964de39c372cf9f"
I20260810 06:33:46.945603 16017 raft_consensus.cc:3037] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:46.945688 15787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93f895d05d5f4ae48bc94e3795bfecfe" candidate_uuid: "cc9080cb0e574319be20c5d14899e835" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1be36dc580a04c0e91cd828b7fefb415"
I20260810 06:33:46.945848 15787 raft_consensus.cc:3037] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:33:46.946868 16017 raft_consensus.cc:2454] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9080cb0e574319be20c5d14899e835 in term 1.
I20260810 06:33:46.947117 15787 raft_consensus.cc:2454] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9080cb0e574319be20c5d14899e835 in term 1.
I20260810 06:33:46.947242 16113 leader_election.cc:302] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04703131db464a1c9964de39c372cf9f, cc9080cb0e574319be20c5d14899e835; no voters:
I20260810 06:33:46.947455 16311 raft_consensus.cc:2781] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:33:46.947687 16311 raft_consensus.cc:686] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 1 LEADER]: Becoming Leader. State: Replica: cc9080cb0e574319be20c5d14899e835, State: Running, Role: LEADER
I20260810 06:33:46.948103 16311 consensus_queue.cc:237] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:33:46.951727 15562 catalog_manager.cc:5495] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 reported cstate change: term changed from 0 to 1, leader changed from <none> to cc9080cb0e574319be20c5d14899e835 (127.21.195.195). New cstate: current_term: 1 leader_uuid: "cc9080cb0e574319be20c5d14899e835" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260810 06:33:46.972821 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:46.969467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46292 (local address 127.21.195.195:37467)
0810 06:33:46.969615 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 06:33:46.969619 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:33:46.969633 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:33:46.969720 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:33:46.969722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:33:46.969783 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:33:46.969882 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:33:46.970081 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.970622 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.971418 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:33:46.971629 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:33:46.971699 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:33:46.971937 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:33:46.972438 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:33:46.972534 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 06:33:46.972602 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 06:33:46.972667 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260810 06:33:46.979660 15787 raft_consensus.cc:1261] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Refusing update from remote peer cc9080cb0e574319be20c5d14899e835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:46.979672 16017 raft_consensus.cc:1261] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 1 FOLLOWER]: Refusing update from remote peer cc9080cb0e574319be20c5d14899e835: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:33:46.980388 16317 consensus_queue.cc:1035] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:46.980597 16311 consensus_queue.cc:1035] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:33:46.988049 16323 mvcc.cc:205] Tried to move back new op lower bound from 7316863496100556800 to 7316863495982583808. Current Snapshot: MvccSnapshot[applied={T|T < 7316863496100556800}]
I20260810 06:33:46.997586 15557 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:33:46.997783 15557 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:33:47.000484 15557 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Sending DeleteTablet for 3 replicas of tablet 93f895d05d5f4ae48bc94e3795bfecfe
I20260810 06:33:47.001365 15989 tablet_service.cc:1514] Processing DeleteTablet for tablet 93f895d05d5f4ae48bc94e3795bfecfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:46 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:49036
I20260810 06:33:47.001504 15754 tablet_service.cc:1514] Processing DeleteTablet for tablet 93f895d05d5f4ae48bc94e3795bfecfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:46 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:40680
I20260810 06:33:47.001637 16185 tablet_service.cc:1514] Processing DeleteTablet for tablet 93f895d05d5f4ae48bc94e3795bfecfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:33:46 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:46286
I20260810 06:33:47.002079 16344 tablet_replica.cc:330] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: stopping tablet replica
I20260810 06:33:47.002338 16347 tablet_replica.cc:330] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: stopping tablet replica
I20260810 06:33:47.002365 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 15620
I20260810 06:33:47.002614 16347 raft_consensus.cc:2229] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:33:47.005496 16347 raft_consensus.cc:2258] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:47.013800 16344 raft_consensus.cc:2229] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:33:47.014312 16344 raft_consensus.cc:2258] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:33:47.015202 16347 ts_tablet_manager.cc:1905] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:47.018940 16347 ts_tablet_manager.cc:1918] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:47.019076 16347 log.cc:1196] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/93f895d05d5f4ae48bc94e3795bfecfe
I20260810 06:33:47.019449 16347 ts_tablet_manager.cc:1939] T 93f895d05d5f4ae48bc94e3795bfecfe P cc9080cb0e574319be20c5d14899e835: Deleting consensus metadata
I20260810 06:33:47.021054 15535 catalog_manager.cc:4841] TS cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467): tablet 93f895d05d5f4ae48bc94e3795bfecfe (table test-table [id=d4088f456a5f4527bc1c9fdb6768652a]) successfully deleted
I20260810 06:33:47.022647 16344 ts_tablet_manager.cc:1905] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:33:47.025794 16344 ts_tablet_manager.cc:1918] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:33:47.025918 16344 log.cc:1196] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/93f895d05d5f4ae48bc94e3795bfecfe
W20260810 06:33:47.025890 15539 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:35255 (error 108)
I20260810 06:33:47.026296 16344 ts_tablet_manager.cc:1939] T 93f895d05d5f4ae48bc94e3795bfecfe P 04703131db464a1c9964de39c372cf9f: Deleting consensus metadata
W20260810 06:33:47.027153 16300 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:33:47.026853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35255 (local address 127.0.0.1:40684)
0810 06:33:47.026985 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:47.027061 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35255: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 06:33:47.027361 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 15875
W20260810 06:33:47.027362 15539 catalog_manager.cc:4584] TS 1be36dc580a04c0e91cd828b7fefb415 (127.21.195.193:35255): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93f895d05d5f4ae48bc94e3795bfecfe: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35255: connect: Connection reset by peer (error 104)
I20260810 06:33:47.095649 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:47.095230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35255 (local address 127.0.0.1:40686)
0810 06:33:47.095468 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:47.095540 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
I20260810 06:33:47.096545 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:47.096237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:35255 (local address 127.0.0.1:40698)
0810 06:33:47.096407 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:47.096459 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:35255: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260810 06:33:47.103127 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 16081
I20260810 06:33:47.103259 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:33:47.102909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:45727 (local address 127.0.0.1:49052)
0810 06:33:47.103106 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 06:33:47.103160 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.194:45727: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260810 06:33:47.130769 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 15505
I20260810 06:34:07.145839 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35219
--webserver_interface=127.21.195.254
--webserver_port=44405
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:35219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:07.273665 16351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:07.274006 16351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:07.274049 16351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:07.278251 16351 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 06:34:07.278328 16351 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 06:34:07.278343 16351 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 06:34:07.278357 16351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:07.278375 16351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:07.278393 16351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:07.278407 16351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:07.278421 16351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:07.284168 16351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:35219
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=44405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:07.285451 16351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:07.286679 16351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:07.296186 16363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:07.296267 16364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:07.296367 16351 server_base.cc:1034] running on GCE node
W20260810 06:34:07.296190 16366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:07.297133 16351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:07.298442 16351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:07.299623 16351 hybrid_clock.cc:648] HybridClock initialized: now 1786343647299588 us; error 51 us; skew 500 ppm
Aug 10 06:34:07 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343647, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:07.302754 16351 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:34:07.303807 16351 webserver.cc:460] Webserver started at http://127.21.195.254:44405/ using document root <none> and password file <none>
I20260810 06:34:07.304497 16351 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:07.304576 16351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:07.309077 16351 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:34:07.311614 16378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:07.313041 16351 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 06:34:07.313179 16351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "391e2c3ed85e43ad9abea4958f852cc9"
format_stamp: "Formatted at 2026-08-10 06:33:24 on dist-test-slave-7lbf"
server_key: "06495000d34ae740e017a777dabaff3e"
server_key_iv: "bacc8e2418b4ab041bcf64ecc0ad6200"
server_key_version: "encryptionkey@0"
I20260810 06:34:07.313887 16351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:07.329341 16351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:07.332664 16351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:07.332882 16351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:07.340413 16351 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:35219
I20260810 06:34:07.340700 16450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:35219 every 8 connection(s)
I20260810 06:34:07.341689 16351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:07.345014 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 16351
I20260810 06:34:07.345577 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:35255
--local_ip_for_outbound_sockets=127.21.195.193
--tserver_master_addrs=127.21.195.254:35219
--webserver_port=34871
--webserver_interface=127.21.195.193
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:34:07.347265 16451 sys_catalog.cc:263] Verifying existing consensus state
I20260810 06:34:07.349260 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Bootstrap starting.
I20260810 06:34:07.367435 16451 log.cc:824] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:07.379818 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:34:07.380296 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Bootstrap complete.
I20260810 06:34:07.384557 16451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:34:07.385020 16451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391e2c3ed85e43ad9abea4958f852cc9, State: Initialized, Role: FOLLOWER
I20260810 06:34:07.385601 16451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:34:07.385739 16451 raft_consensus.cc:388] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:07.385844 16451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:07.385959 16451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 2 FOLLOWER]: Advancing to term 3
I20260810 06:34:07.388156 16451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:34:07.388538 16451 leader_election.cc:302] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 391e2c3ed85e43ad9abea4958f852cc9; no voters:
I20260810 06:34:07.388926 16451 leader_election.cc:288] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 06:34:07.389043 16456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 06:34:07.389248 16456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [term 3 LEADER]: Becoming Leader. State: Replica: 391e2c3ed85e43ad9abea4958f852cc9, State: Running, Role: LEADER
I20260810 06:34:07.389623 16456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } }
I20260810 06:34:07.390405 16451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:07.391175 16457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "391e2c3ed85e43ad9abea4958f852cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } } }
I20260810 06:34:07.391324 16457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:07.391989 16458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 391e2c3ed85e43ad9abea4958f852cc9. Latest consensus state: current_term: 3 leader_uuid: "391e2c3ed85e43ad9abea4958f852cc9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "391e2c3ed85e43ad9abea4958f852cc9" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35219 } } }
I20260810 06:34:07.392099 16458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:07.392410 16467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:07.397123 16467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:07.397768 16467 catalog_manager.cc:1259] Loaded cluster ID: e0b062498031457ba7e93550834811e4
I20260810 06:34:07.397832 16467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:07.399731 16467 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:07.400394 16467 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Loaded TSK: 0
I20260810 06:34:07.400470 16467 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 391e2c3ed85e43ad9abea4958f852cc9: Loaded TSK: 1
F20260810 06:34:07.401137 16467 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f36951009ad google::LogMessage::Fail() at ??:0
@ 0x7f369510388a google::LogMessage::SendToLog() at ??:0
@ 0x7f36951004de google::LogMessage::Flush() at ??:0
@ 0x7f3695101a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f3697dc418d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f3697dbcf0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f369fa697bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f369fa4399c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f369fa44178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f369fa85df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f369faa482b std::function<>::operator()() at ??:0
@ 0x7f369fa43b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f369fa44f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f369fa41579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f369fa85640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f36973523d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f3697352c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f36973543f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
W20260810 06:34:07.495890 16454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:07.496301 16454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:07.496392 16454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
@ 0x7f3697343512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f36989876db start_thread at ??:0
@ 0x7f3693bfe61f clone at ??:0
W20260810 06:34:07.503476 16454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:07.503556 16454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:07.503650 16454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:34:07.512133 16454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:35255
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=34871
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:07.513881 16454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:07.515475 16454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:07.528949 16522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:07.528962 16523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:07.528995 16526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:07.529897 16454 server_base.cc:1034] running on GCE node
I20260810 06:34:07.530402 16454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:07.531138 16454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:07.532332 16454 hybrid_clock.cc:648] HybridClock initialized: now 1786343647532311 us; error 36 us; skew 500 ppm
Aug 10 06:34:07 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343647, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:07.535435 16454 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:34:07.536516 16454 webserver.cc:460] Webserver started at http://127.21.195.193:34871/ using document root <none> and password file <none>
I20260810 06:34:07.537147 16454 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:07.537215 16454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:07.541805 16454 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:34:07.544406 16541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:07.546046 16454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:07.546193 16454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "1be36dc580a04c0e91cd828b7fefb415"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "1da932721a424c6c47fd2db28a5c3c08"
server_key_iv: "cd29561508f453408545450967cfd5fb"
server_key_version: "encryptionkey@0"
I20260810 06:34:07.546839 16454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:07.576102 16454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:07.579932 16454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:07.580145 16454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:07.580837 16454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:07.582152 16551 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 06:34:07.586900 16454 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 06:34:07.586980 16454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260810 06:34:07.587042 16454 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 06:34:07.588991 16454 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 06:34:07.589066 16454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260810 06:34:07.589392 16551 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Bootstrap starting.
I20260810 06:34:07.600392 16454 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:35255
I20260810 06:34:07.600741 16715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:35255 every 8 connection(s)
I20260810 06:34:07.601953 16454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:34:07.605875 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 16454
I20260810 06:34:07.606421 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:45727
--local_ip_for_outbound_sockets=127.21.195.194
--tserver_master_addrs=127.21.195.254:35219
--webserver_port=43061
--webserver_interface=127.21.195.194
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:34:07.611773 16551 log.cc:824] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:07.619927 16551 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 06:34:07.620363 16551 tablet_bootstrap.cc:492] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Bootstrap complete.
I20260810 06:34:07.621363 16551 ts_tablet_manager.cc:1397] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Time spent bootstrapping tablet: real 0.032s user 0.017s sys 0.011s
I20260810 06:34:07.624055 16551 raft_consensus.cc:348] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:34:07.624540 16551 raft_consensus.cc:729] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1be36dc580a04c0e91cd828b7fefb415, State: Initialized, Role: FOLLOWER
I20260810 06:34:07.625102 16551 consensus_queue.cc:260] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:34:07.626236 16551 ts_tablet_manager.cc:1428] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
W20260810 06:34:07.692867 16719 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:34:07.604657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:60205)
0810 06:34:07.607737 (+ 3080us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:07.607841 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:07.609183 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:07.691688 (+ 82505us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":2736,"thread_start_us":171,"threads_started":1}
W20260810 06:34:07.693612 16716 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:35219 (0 consecutive failures): Network error: Failed to ping master at 127.21.195.254:35219: Client connection negotiation failed: client connection to 127.21.195.254:35219: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 06:34:07.694476 16719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:07.694156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:60493)
0810 06:34:07.694309 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:07.694400 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 06:34:07.695243 16719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:07.695010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:35021)
0810 06:34:07.695125 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:07.695179 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 06:34:07.695428 16716 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:34:07.752586 16721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:07.752914 16721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:07.752964 16721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:07.757350 16721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:07.757428 16721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:07.757491 16721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:34:07.763340 16721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:45727
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=43061
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:07.764566 16721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:07.765724 16721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:07.776557 16733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:07.776607 16738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:07.776557 16734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:07.776928 16721 server_base.cc:1034] running on GCE node
I20260810 06:34:07.777371 16721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:07.778117 16721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:07.779277 16721 hybrid_clock.cc:648] HybridClock initialized: now 1786343647779257 us; error 35 us; skew 500 ppm
Aug 10 06:34:07 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343647, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:07.782290 16721 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:34:07.783308 16721 webserver.cc:460] Webserver started at http://127.21.195.194:43061/ using document root <none> and password file <none>
I20260810 06:34:07.783941 16721 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:07.784014 16721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:07.788378 16721 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:34:07.790835 16750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:07.792217 16721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:07.792339 16721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "04703131db464a1c9964de39c372cf9f"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "551548098468d68f52996624a3f8a477"
server_key_iv: "04f113c3c24347d065b1e5f102e10f37"
server_key_version: "encryptionkey@0"
I20260810 06:34:07.792986 16721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:07.811280 16721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:07.814883 16721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:07.815097 16721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:07.815809 16721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:07.816771 16721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:07.816821 16721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:07.816890 16721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:07.816919 16721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:07.826009 16721 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:45727
I20260810 06:34:07.826040 16910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:45727 every 8 connection(s)
I20260810 06:34:07.827172 16721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:34:07.828454 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 16721
I20260810 06:34:07.828923 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:37467
--local_ip_for_outbound_sockets=127.21.195.195
--tserver_master_addrs=127.21.195.254:35219
--webserver_port=40815
--webserver_interface=127.21.195.195
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:34:07.831581 16916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:07.829731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:36443)
0810 06:34:07.830597 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:07.830748 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":130,"threads_started":1}
W20260810 06:34:07.832082 16911 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:35219 (0 consecutive failures): Network error: Failed to ping master at 127.21.195.254:35219: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
I20260810 06:34:07.832784 16916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:07.832524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:44233)
0810 06:34:07.832646 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:07.832708 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260810 06:34:07.833475 16916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:07.833223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:55577)
0810 06:34:07.833345 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:07.833399 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 06:34:07.833704 16911 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 06:34:07.954171 16918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:07.954484 16918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:07.954530 16918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:07.958796 16918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:07.958875 16918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:07.958945 16918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:34:07.964608 16918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:37467
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=40815
--tserver_master_addrs=127.21.195.254:35219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:07.965881 16918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:07.967103 16918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:07.977746 16925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:07.977824 16918 server_base.cc:1034] running on GCE node
W20260810 06:34:07.977814 16929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:07.977759 16932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:07.978503 16918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:07.979255 16918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:07.980438 16918 hybrid_clock.cc:648] HybridClock initialized: now 1786343647980415 us; error 39 us; skew 500 ppm
Aug 10 06:34:07 dist-test-slave-7lbf krb5kdc[14635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343647, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:07.983719 16918 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:34:07.984774 16918 webserver.cc:460] Webserver started at http://127.21.195.195:40815/ using document root <none> and password file <none>
I20260810 06:34:07.985391 16918 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:07.985460 16918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:07.989981 16918 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:34:07.992498 16941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:07.994059 16918 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:07.994189 16918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "cc9080cb0e574319be20c5d14899e835"
format_stamp: "Formatted at 2026-08-10 06:33:25 on dist-test-slave-7lbf"
server_key: "e2177c1b75c2cf855404bef4407a7591"
server_key_iv: "e3e338a558462eeeedb7d51a9438666a"
server_key_version: "encryptionkey@0"
I20260810 06:34:07.994801 16918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:08.022675 16918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:08.026460 16918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:08.026655 16918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:08.027304 16918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:08.028319 16918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:08.028376 16918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:08.028421 16918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:08.028436 16918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:08.037744 16918 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:37467
I20260810 06:34:08.037801 17124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:37467 every 8 connection(s)
I20260810 06:34:08.038923 16918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:34:08.042950 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:08.041274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:47237)
0810 06:34:08.042021 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:08.042146 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":146,"threads_started":1}
W20260810 06:34:08.043442 17126 heartbeater.cc:644] Failed to heartbeat to 127.21.195.254:35219 (0 consecutive failures): Network error: Failed to ping master at 127.21.195.254:35219: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
I20260810 06:34:08.044126 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:08.043901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:35481)
0810 06:34:08.044014 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:08.044066 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 06:34:08.044727 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:08.044529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:50555)
0810 06:34:08.044629 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:08.044672 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 06:34:08.044899 17126 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 06:34:08.047978 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 16918
I20260810 06:34:08.696758 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:08.696191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:36869)
0810 06:34:08.696502 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:08.696589 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":87,"threads_started":1}
I20260810 06:34:08.834862 17132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:08.834380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:47641)
0810 06:34:08.834670 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:08.834740 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":84,"threads_started":1}
I20260810 06:34:09.046118 17133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:09.045633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:37765)
0810 06:34:09.045922 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:09.045993 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":90,"threads_started":1}
I20260810 06:34:09.450537 17134 raft_consensus.cc:482] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:09.450814 17134 raft_consensus.cc:504] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:34:09.452039 17134 leader_election.cc:288] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727), cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467)
Aug 10 06:34:09 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343647, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.195@KRBTEST.COM
Aug 10 06:34:09 dist-test-slave-7lbf krb5kdc[14635](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343647, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.194@KRBTEST.COM
I20260810 06:34:09.471710 17137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:09.452483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:48177 (local address 127.21.195.194:45727)
0810 06:34:09.453079 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:09.453091 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:09.453127 (+ 36us) server_negotiation.cc:407] Connection header received
0810 06:34:09.453820 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:09.453826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:09.454139 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:09.454435 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:09.455818 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:09.456797 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:09.458187 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:09.458668 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:09.458833 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:09.466989 (+ 8156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:09.466995 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:09.467011 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:09.467047 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:09.468731 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:09.469434 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:09.469440 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:09.469444 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:09.469633 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:09.470015 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:09.470019 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:09.470021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:09.470510 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:09.470639 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:09.471221 (+ 582us) server_negotiation.cc:299] Negotiation successful
0810 06:34:09.471513 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":75,"threads_started":1}
I20260810 06:34:09.471755 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:09.452307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:37467 (local address 127.21.195.193:37413)
0810 06:34:09.452772 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:09.452784 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:09.452846 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:09.454545 (+ 1699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:09.454553 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:09.455116 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:09.455624 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:09.455641 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:09.456953 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:09.456956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:09.458057 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:09.458068 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:09.458804 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:09.458808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:09.459043 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:09.464592 (+ 5549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:09.464616 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:09.466429 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:09.468875 (+ 2446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:09.468881 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:09.468897 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:09.469295 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:09.469726 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:09.469729 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:09.469732 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:09.469912 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:09.470632 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:09.470638 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:09.470886 (+ 248us) client_negotiation.cc:769] Sending connection context
0810 06:34:09.471071 (+ 185us) client_negotiation.cc:240] Negotiation successful
0810 06:34:09.471594 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":201,"spinlock_wait_cycles":35584,"thread_start_us":69,"threads_started":1}
I20260810 06:34:09.472012 17138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:09.452484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:37413 (local address 127.21.195.195:37467)
0810 06:34:09.452902 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:09.452928 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:09.452970 (+ 42us) server_negotiation.cc:407] Connection header received
0810 06:34:09.453747 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:09.453754 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:09.454135 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:09.454444 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:09.455815 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:09.456797 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:09.458183 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:09.458670 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:09.458834 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:09.466764 (+ 7930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:09.466771 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:09.466789 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:09.466828 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:09.468698 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:09.469431 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:09.469438 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:09.469442 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:09.469633 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:09.470010 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:09.470014 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:09.470015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:09.470510 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:09.470639 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:09.471213 (+ 574us) server_negotiation.cc:299] Negotiation successful
0810 06:34:09.471544 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":130,"threads_started":1}
I20260810 06:34:09.472291 17136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:09.452307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:45727 (local address 127.21.195.193:48177)
0810 06:34:09.452688 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:09.452705 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:09.452842 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:09.454545 (+ 1703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:09.454553 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:09.455116 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:09.455625 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:09.455641 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:09.456951 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:09.456955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:09.458058 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:09.458068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:09.458799 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:09.458802 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:09.459041 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:09.464594 (+ 5553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:09.464617 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:09.466725 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:09.468874 (+ 2149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:09.468881 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:09.468898 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:09.469295 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:09.469728 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:09.469732 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:09.469734 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:09.469917 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:09.470632 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:09.470639 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:09.470887 (+ 248us) client_negotiation.cc:769] Sending connection context
0810 06:34:09.471069 (+ 182us) client_negotiation.cc:240] Negotiation successful
0810 06:34:09.471426 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":202,"spinlock_wait_cycles":79488,"thread_start_us":103,"threads_started":1}
W20260810 06:34:09.474705 16543 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
W20260810 06:34:09.474882 16542 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
I20260810 06:34:09.474961 16542 leader_election.cc:302] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be36dc580a04c0e91cd828b7fefb415; no voters: 04703131db464a1c9964de39c372cf9f, cc9080cb0e574319be20c5d14899e835
I20260810 06:34:09.475222 17134 raft_consensus.cc:2726] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:34:09.697984 17136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:09.697628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:57395)
0810 06:34:09.697796 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:09.697886 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 06:34:09.836381 17139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:09.835801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:37289)
0810 06:34:09.836128 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:09.836217 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":90,"threads_started":1}
I20260810 06:34:10.047519 17140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:10.047027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:59083)
0810 06:34:10.047338 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:10.047413 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":89,"threads_started":1}
I20260810 06:34:10.699326 17145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:10.698842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:47761)
0810 06:34:10.699147 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:10.699219 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":85,"threads_started":1}
I20260810 06:34:10.837872 17147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:10.837363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:49343)
0810 06:34:10.837694 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:10.837761 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":115,"threads_started":1}
I20260810 06:34:11.048998 17148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:11.048479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:54097)
0810 06:34:11.048814 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:11.048884 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":110,"threads_started":1}
I20260810 06:34:11.393733 17150 raft_consensus.cc:482] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:11.393874 17150 raft_consensus.cc:504] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:34:11.394279 17150 leader_election.cc:288] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727), cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467)
W20260810 06:34:11.395205 16542 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
W20260810 06:34:11.395335 16543 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
I20260810 06:34:11.395404 16543 leader_election.cc:302] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be36dc580a04c0e91cd828b7fefb415; no voters: 04703131db464a1c9964de39c372cf9f, cc9080cb0e574319be20c5d14899e835
I20260810 06:34:11.395547 17150 raft_consensus.cc:2726] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:34:11.700850 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:11.700300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:41587)
0810 06:34:11.700647 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:11.700732 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":110,"threads_started":1}
I20260810 06:34:11.839434 17155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:11.838894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:59685)
0810 06:34:11.839229 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:11.839296 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":116,"threads_started":1}
I20260810 06:34:12.050328 17156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:12.049855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:57577)
0810 06:34:12.050122 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:12.050211 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":97,"threads_started":1}
I20260810 06:34:12.702550 17157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:12.701937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:37209)
0810 06:34:12.702348 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:12.702428 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":131,"threads_started":1}
I20260810 06:34:12.840828 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:12.840316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:45603)
0810 06:34:12.840639 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:12.840711 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":85,"threads_started":1}
I20260810 06:34:13.051707 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:13.051155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:50771)
0810 06:34:13.051478 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:13.051544 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":105,"threads_started":1}
I20260810 06:34:13.703847 17162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:13.703364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:35753)
0810 06:34:13.703684 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:13.703742 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":118,"threads_started":1}
I20260810 06:34:13.842386 17163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:13.841869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:37825)
0810 06:34:13.842189 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:13.842262 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":88,"threads_started":1}
I20260810 06:34:14.053121 17164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:14.052590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:43555)
0810 06:34:14.052934 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:14.053007 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":111,"threads_started":1}
I20260810 06:34:14.374912 17166 raft_consensus.cc:482] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:14.375063 17166 raft_consensus.cc:504] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:34:14.375538 17166 leader_election.cc:288] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727), cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467)
W20260810 06:34:14.376394 16542 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
W20260810 06:34:14.376525 16543 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
I20260810 06:34:14.376629 16543 leader_election.cc:302] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be36dc580a04c0e91cd828b7fefb415; no voters: 04703131db464a1c9964de39c372cf9f, cc9080cb0e574319be20c5d14899e835
I20260810 06:34:14.376844 17166 raft_consensus.cc:2726] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:34:14.705122 17167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:14.704607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:60503)
0810 06:34:14.704946 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:14.705014 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":113,"threads_started":1}
I20260810 06:34:14.843984 17168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:14.843376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:50913)
0810 06:34:14.843780 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:14.843874 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":107,"threads_started":1}
I20260810 06:34:15.054564 17170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:15.054038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:60485)
0810 06:34:15.054387 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:15.054455 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":84,"threads_started":1}
I20260810 06:34:15.706593 17171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:15.706119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:48607)
0810 06:34:15.706400 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:15.706481 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":87,"threads_started":1}
I20260810 06:34:15.845193 17174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:15.844754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:48659)
0810 06:34:15.845031 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:15.845090 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":92,"threads_started":1}
I20260810 06:34:16.055883 17175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:16.055382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:56645)
0810 06:34:16.055691 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:16.055750 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":108,"threads_started":1}
I20260810 06:34:16.708047 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:16.707515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:41665)
0810 06:34:16.707844 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:16.707927 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":98,"threads_started":1}
I20260810 06:34:16.846551 17179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:16.846085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:55495)
0810 06:34:16.846369 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:16.846439 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":87,"threads_started":1}
I20260810 06:34:16.956497 17181 raft_consensus.cc:482] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:16.956657 17181 raft_consensus.cc:504] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:34:16.957134 17181 leader_election.cc:288] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727), cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467)
W20260810 06:34:16.958000 16542 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
W20260810 06:34:16.958127 16543 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
I20260810 06:34:16.958206 16543 leader_election.cc:302] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be36dc580a04c0e91cd828b7fefb415; no voters: 04703131db464a1c9964de39c372cf9f, cc9080cb0e574319be20c5d14899e835
I20260810 06:34:16.958349 17181 raft_consensus.cc:2726] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:34:17.057253 17182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:17.056734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:45315)
0810 06:34:17.057061 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:17.057135 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":117,"threads_started":1}
I20260810 06:34:17.709371 17184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:17.708911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:34105)
0810 06:34:17.709192 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:17.709256 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":84,"threads_started":1}
I20260810 06:34:17.848016 17187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:17.847491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:38019)
0810 06:34:17.847827 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:17.847904 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":87,"threads_started":1}
I20260810 06:34:18.058748 17188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:18.058246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:35873)
0810 06:34:18.058563 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:18.058637 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":90,"threads_started":1}
I20260810 06:34:18.710798 17189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:18.710304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:59999)
0810 06:34:18.710602 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:18.710674 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":86,"threads_started":1}
I20260810 06:34:18.849261 17190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:18.848800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:42993)
0810 06:34:18.849087 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:18.849151 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":85,"threads_started":1}
I20260810 06:34:19.060051 17191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:19.059576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:52899)
0810 06:34:19.059873 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:19.059941 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":88,"threads_started":1}
I20260810 06:34:19.712083 17193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:19.711594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:47873)
0810 06:34:19.711912 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:19.711976 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":92,"threads_started":1}
I20260810 06:34:19.850772 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:19.850263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:37383)
0810 06:34:19.850581 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:19.850657 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":86,"threads_started":1}
I20260810 06:34:20.061460 17197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:20.061001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:50779)
0810 06:34:20.061285 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:20.061353 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":90,"threads_started":1}
I20260810 06:34:20.713465 17199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:20.713010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:39571)
0810 06:34:20.713286 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:20.713354 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":88,"threads_started":1}
I20260810 06:34:20.852227 17203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:20.851642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:60857)
0810 06:34:20.851978 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:20.852061 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":96,"threads_started":1}
I20260810 06:34:21.062996 17205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:21.062488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:51479)
0810 06:34:21.062795 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:21.062866 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":88,"threads_started":1}
I20260810 06:34:21.714860 17206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:21.714364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:46675)
0810 06:34:21.714679 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:21.714749 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":87,"threads_started":1}
I20260810 06:34:21.742830 17208 raft_consensus.cc:482] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:21.742980 17208 raft_consensus.cc:504] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04703131db464a1c9964de39c372cf9f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 45727 } } peers { permanent_uuid: "cc9080cb0e574319be20c5d14899e835" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 37467 } } peers { permanent_uuid: "1be36dc580a04c0e91cd828b7fefb415" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 35255 } }
I20260810 06:34:21.743389 17208 leader_election.cc:288] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727), cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467)
W20260810 06:34:21.744246 16542 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer cc9080cb0e574319be20c5d14899e835 (127.21.195.195:37467): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
W20260810 06:34:21.744374 16543 leader_election.cc:341] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 04703131db464a1c9964de39c372cf9f (127.21.195.194:45727): Not found: Tablet not found: 93f895d05d5f4ae48bc94e3795bfecfe
I20260810 06:34:21.744447 16543 leader_election.cc:302] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1be36dc580a04c0e91cd828b7fefb415; no voters: 04703131db464a1c9964de39c372cf9f, cc9080cb0e574319be20c5d14899e835
I20260810 06:34:21.744591 17208 raft_consensus.cc:2726] T 93f895d05d5f4ae48bc94e3795bfecfe P 1be36dc580a04c0e91cd828b7fefb415 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 06:34:21.853566 17210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:21.853078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:59291)
0810 06:34:21.853347 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:21.853413 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":86,"threads_started":1}
I20260810 06:34:22.064281 17211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:22.063812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:43271)
0810 06:34:22.064111 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:22.064176 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":90,"threads_started":1}
I20260810 06:34:22.716431 17212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:22.715966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.193:35073)
0810 06:34:22.716263 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:22.716320 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":99,"threads_started":1}
I20260810 06:34:22.855070 17214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:22.854549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.194:46023)
0810 06:34:22.854862 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:22.854956 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":105,"threads_started":1}
I20260810 06:34:23.058493 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 16454
I20260810 06:34:23.080135 17217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:23.066295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35219 (local address 127.21.195.195:55589)
0810 06:34:23.079908 (+ 13613us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:23.080001 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.254:35219: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13482,"thread_start_us":80,"threads_started":1}
I20260810 06:34:23.087806 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 16721
I20260810 06:34:23.101919 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 16918
2026-08-10T06:34:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59765 ms)
[----------] 30 tests from SecurityITest (255430 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:23 dist-test-slave-7lbf krb5kdc[17220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:23 dist-test-slave-7lbf krb5kdc[17220](info): set up 2 sockets
Aug 10 06:34:23 dist-test-slave-7lbf krb5kdc[17220](info): commencing operation
krb5kdc: starting...
W20260810 06:34:24.339980 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:24 dist-test-slave-7lbf krb5kdc[17220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:34:24.476297 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:37547
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:37547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:24.599907 17236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:24.600240 17236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:24.600301 17236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:24.604566 17236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:24.604651 17236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:24.604681 17236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:24.604701 17236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:24.604722 17236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:24.610596 17236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:37547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:37547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:24.611882 17236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:24.613060 17236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:34:24.622603 17236 server_base.cc:1034] running on GCE node
W20260810 06:34:24.622537 17244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:24.622514 17250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:24.622555 17246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:24.623432 17236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:24.624715 17236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:24.625888 17236 hybrid_clock.cc:648] HybridClock initialized: now 1786343664625868 us; error 35 us; skew 500 ppm
Aug 10 06:34:24 dist-test-slave-7lbf krb5kdc[17220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343664, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:24.628958 17236 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:34:24.630049 17236 webserver.cc:460] Webserver started at http://127.21.195.254:45991/ using document root <none> and password file <none>
I20260810 06:34:24.630695 17236 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:24.630774 17236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:24.631021 17236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:24.633358 17236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "61816025be64472ebcd2b4a686d6ca5d"
format_stamp: "Formatted at 2026-08-10 06:34:24 on dist-test-slave-7lbf"
server_key: "f3f1d25e525f8f04a70a8a1cce283e24"
server_key_iv: "ad05bcf05578200fa67f2f17ba5c66ce"
server_key_version: "encryptionkey@0"
I20260810 06:34:24.634066 17236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "61816025be64472ebcd2b4a686d6ca5d"
format_stamp: "Formatted at 2026-08-10 06:34:24 on dist-test-slave-7lbf"
server_key: "f3f1d25e525f8f04a70a8a1cce283e24"
server_key_iv: "ad05bcf05578200fa67f2f17ba5c66ce"
server_key_version: "encryptionkey@0"
I20260810 06:34:24.638429 17236 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:24.641228 17259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:24.642675 17236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:24.642817 17236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "61816025be64472ebcd2b4a686d6ca5d"
format_stamp: "Formatted at 2026-08-10 06:34:24 on dist-test-slave-7lbf"
server_key: "f3f1d25e525f8f04a70a8a1cce283e24"
server_key_iv: "ad05bcf05578200fa67f2f17ba5c66ce"
server_key_version: "encryptionkey@0"
I20260810 06:34:24.642942 17236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:24.676869 17236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:24.680673 17236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:24.680896 17236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:24.688771 17236 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:37547
I20260810 06:34:24.688786 17343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:37547 every 8 connection(s)
I20260810 06:34:24.690006 17236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:24.693244 17344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:24.695007 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 17236
I20260810 06:34:24.695149 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:24.695436 22287 external_mini_cluster.cc:1428] Setting key d9dbf8747875a52e8d20a036e402140e
I20260810 06:34:24.700172 17344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d: Bootstrap starting.
I20260810 06:34:24.702669 17344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:24.703449 17344 log.cc:824] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:34:24 dist-test-slave-7lbf krb5kdc[17220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343664, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:24.705852 17344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d: No bootstrap required, opened a new log
I20260810 06:34:24.710806 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:24.696995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57888 (local address 127.21.195.254:37547)
0810 06:34:24.697566 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:24.697585 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:24.697629 (+ 44us) server_negotiation.cc:407] Connection header received
0810 06:34:24.698325 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:24.698344 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:24.698728 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:24.699096 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:24.699940 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:24.701012 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:24.701960 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:24.702476 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:24.702639 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:24.705424 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:24.705429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:24.705452 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:24.705483 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:24.707463 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:24.707915 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:24.707922 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:24.707928 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:24.708092 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:24.708340 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:24.708344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:24.708346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:24.708939 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:24.709140 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:24.709336 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 06:34:24.709701 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":157,"threads_started":1}
I20260810 06:34:24.710776 17344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61816025be64472ebcd2b4a686d6ca5d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37547 } }
I20260810 06:34:24.711125 17344 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:24.711196 17344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61816025be64472ebcd2b4a686d6ca5d, State: Initialized, Role: FOLLOWER
I20260810 06:34:24.711869 17344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61816025be64472ebcd2b4a686d6ca5d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37547 } }
I20260810 06:34:24.712067 17344 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:24.712154 17344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:24.712282 17344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:24.713747 17344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61816025be64472ebcd2b4a686d6ca5d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37547 } }
I20260810 06:34:24.714121 17344 leader_election.cc:302] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61816025be64472ebcd2b4a686d6ca5d; no voters:
I20260810 06:34:24.714459 17344 leader_election.cc:288] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:24.714576 17351 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:24.714771 17351 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [term 1 LEADER]: Becoming Leader. State: Replica: 61816025be64472ebcd2b4a686d6ca5d, State: Running, Role: LEADER
I20260810 06:34:24.715197 17351 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61816025be64472ebcd2b4a686d6ca5d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37547 } }
I20260810 06:34:24.715962 17344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:24.717032 17354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61816025be64472ebcd2b4a686d6ca5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61816025be64472ebcd2b4a686d6ca5d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37547 } } }
I20260810 06:34:24.717185 17354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:24.717543 17353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61816025be64472ebcd2b4a686d6ca5d. Latest consensus state: current_term: 1 leader_uuid: "61816025be64472ebcd2b4a686d6ca5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61816025be64472ebcd2b4a686d6ca5d" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37547 } } }
I20260810 06:34:24.717656 17353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:24.717653 17364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:24.721221 17364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:24.727905 17364 catalog_manager.cc:1347] Generated new cluster ID: f4101476ad7040e793083d90f28c174b
I20260810 06:34:24.728001 17364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:24.753413 17364 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:24.755049 17364 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:24.766498 17364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d: Generated new TSK 0
I20260810 06:34:24.767563 17364 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:34:24.821081 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37547
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:24.959674 17384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:24.960032 17384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:24.960107 17384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:24.964465 17384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:24.964570 17384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:24.964669 17384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:34:24.970582 17384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:24.971951 17384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:24.973218 17384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:24.984335 17396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:24.984345 17392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:24.984443 17384 server_base.cc:1034] running on GCE node
W20260810 06:34:24.984361 17393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:24.985136 17384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:24.985960 17384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:24.987150 17384 hybrid_clock.cc:648] HybridClock initialized: now 1786343664987120 us; error 47 us; skew 500 ppm
Aug 10 06:34:24 dist-test-slave-7lbf krb5kdc[17220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343664, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:24.990434 17384 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:34:24.991631 17384 webserver.cc:460] Webserver started at http://127.21.195.193:42265/ using document root <none> and password file <none>
I20260810 06:34:24.992233 17384 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:24.992306 17384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:24.992539 17384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:24.994889 17384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "99bc8d6706544036a89400e718a9bc51"
format_stamp: "Formatted at 2026-08-10 06:34:24 on dist-test-slave-7lbf"
server_key: "efe81d37100b0bd5c5f8c92a49f5fd06"
server_key_iv: "850f8ca41a774a9ceca17a09c6c6d434"
server_key_version: "encryptionkey@0"
I20260810 06:34:24.995510 17384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "99bc8d6706544036a89400e718a9bc51"
format_stamp: "Formatted at 2026-08-10 06:34:24 on dist-test-slave-7lbf"
server_key: "efe81d37100b0bd5c5f8c92a49f5fd06"
server_key_iv: "850f8ca41a774a9ceca17a09c6c6d434"
server_key_version: "encryptionkey@0"
I20260810 06:34:24.999912 17384 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:34:25.002974 17408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.004480 17384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:25.004655 17384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "99bc8d6706544036a89400e718a9bc51"
format_stamp: "Formatted at 2026-08-10 06:34:24 on dist-test-slave-7lbf"
server_key: "efe81d37100b0bd5c5f8c92a49f5fd06"
server_key_iv: "850f8ca41a774a9ceca17a09c6c6d434"
server_key_version: "encryptionkey@0"
I20260810 06:34:25.004820 17384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:25.022785 17384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:25.026463 17384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:25.026698 17384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:25.027418 17384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:25.028429 17384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:25.028493 17384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.028558 17384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:25.028585 17384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.038144 17384 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:44195
I20260810 06:34:25.038170 17589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:44195 every 8 connection(s)
I20260810 06:34:25.039183 17384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:34:25.043373 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 17384
I20260810 06:34:25.043493 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:34:25.043780 22287 external_mini_cluster.cc:1428] Setting key c5c2371d3a2121ffefd2e30063dfd72c
Aug 10 06:34:25 dist-test-slave-7lbf krb5kdc[17220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343664, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:25.055326 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.041251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:49081 (local address 127.21.195.254:37547)
0810 06:34:25.041414 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.041419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.042432 (+ 1013us) server_negotiation.cc:407] Connection header received
0810 06:34:25.043941 (+ 1509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.043945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.044013 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.044119 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:25.045602 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.046350 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.047708 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.048070 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.048181 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.051154 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:25.051159 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:25.051163 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:25.051199 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:25.052853 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:25.053455 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:25.053459 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:25.053461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:25.053599 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:25.053969 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:25.053973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:25.053975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:25.054249 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:25.054362 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.054945 (+ 583us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.055127 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:34:25.056164 17592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.041753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37547 (local address 127.21.195.193:49081)
0810 06:34:25.042257 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.042305 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:25.043683 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:25.044319 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:25.044331 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:25.044763 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:25.045425 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.045447 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.046485 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.046488 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.047576 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.047587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.048251 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.048254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.048431 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.049065 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:25.049083 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:25.050947 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:25.053010 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:25.053017 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:25.053034 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:25.053331 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:25.053694 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:25.053696 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:25.053697 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:25.053865 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:25.054346 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:25.054352 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:25.054648 (+ 296us) client_negotiation.cc:769] Sending connection context
0810 06:34:25.054820 (+ 172us) client_negotiation.cc:240] Negotiation successful
0810 06:34:25.055152 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":123,"threads_started":1}
I20260810 06:34:25.057773 17590 heartbeater.cc:347] Connected to a master server at 127.21.195.254:37547
I20260810 06:34:25.058051 17590 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:34:25.058669 17590 heartbeater.cc:511] Master 127.21.195.254:37547 requested a full tablet report, sending...
I20260810 06:34:25.060429 17285 ts_manager.cc:194] Registered new tserver with Master: 99bc8d6706544036a89400e718a9bc51 (127.21.195.193:44195)
I20260810 06:34:25.062155 17285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:49081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:34:25.076130 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37547
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:25.199391 17595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:25.199712 17595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:25.199761 17595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:25.204035 17595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:25.204118 17595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:25.204188 17595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:34:25.210327 17595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:25.211685 17595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:25.212894 17595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:25.223994 17605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:25.223994 17601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:25.224026 17602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:25.224313 17595 server_base.cc:1034] running on GCE node
I20260810 06:34:25.224799 17595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:25.225553 17595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:25.226732 17595 hybrid_clock.cc:648] HybridClock initialized: now 1786343665226694 us; error 54 us; skew 500 ppm
Aug 10 06:34:25 dist-test-slave-7lbf krb5kdc[17220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343665, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:25.229744 17595 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:34:25.230787 17595 webserver.cc:460] Webserver started at http://127.21.195.194:34665/ using document root <none> and password file <none>
I20260810 06:34:25.231387 17595 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:25.231455 17595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:25.231657 17595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:25.233958 17595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "8ba30af888ae4dc782b9f8deeae310b6"
format_stamp: "Formatted at 2026-08-10 06:34:25 on dist-test-slave-7lbf"
server_key: "55b8a6dcc2857d000e197d4ecfc22e66"
server_key_iv: "0027bb553d607fc10c14b047ef70a828"
server_key_version: "encryptionkey@0"
I20260810 06:34:25.234541 17595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "8ba30af888ae4dc782b9f8deeae310b6"
format_stamp: "Formatted at 2026-08-10 06:34:25 on dist-test-slave-7lbf"
server_key: "55b8a6dcc2857d000e197d4ecfc22e66"
server_key_iv: "0027bb553d607fc10c14b047ef70a828"
server_key_version: "encryptionkey@0"
I20260810 06:34:25.238818 17595 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260810 06:34:25.241633 17614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.243103 17595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 06:34:25.243232 17595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "8ba30af888ae4dc782b9f8deeae310b6"
format_stamp: "Formatted at 2026-08-10 06:34:25 on dist-test-slave-7lbf"
server_key: "55b8a6dcc2857d000e197d4ecfc22e66"
server_key_iv: "0027bb553d607fc10c14b047ef70a828"
server_key_version: "encryptionkey@0"
I20260810 06:34:25.243366 17595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:25.254711 17595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:25.258275 17595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:25.258462 17595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:25.259079 17595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:25.260011 17595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:25.260062 17595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.260106 17595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:25.260126 17595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.269426 17595 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:37681
I20260810 06:34:25.269451 17792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:37681 every 8 connection(s)
I20260810 06:34:25.270538 17595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:34:25.274303 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 17595
I20260810 06:34:25.274426 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:34:25.274703 22287 external_mini_cluster.cc:1428] Setting key 7f928cf6e8af572a24335764e5e8044c
Aug 10 06:34:25 dist-test-slave-7lbf krb5kdc[17220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343665, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:34:25.285898 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.272596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:42803 (local address 127.21.195.254:37547)
0810 06:34:25.272744 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.272747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.273722 (+ 975us) server_negotiation.cc:407] Connection header received
0810 06:34:25.275196 (+ 1474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.275200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.275269 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.275339 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:25.276737 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.277272 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.278522 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.278755 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.278850 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.281691 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:25.281695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:25.281698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:25.281734 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:25.283310 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:25.283857 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:25.283861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:25.283863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:25.283978 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:25.284456 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:25.284459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:25.284460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:25.284717 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:25.284843 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.285472 (+ 629us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.285669 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:34:25.286901 17800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.273021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37547 (local address 127.21.195.194:42803)
0810 06:34:25.273558 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.273610 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:25.274961 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:25.275565 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:25.275574 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:25.276026 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:25.276586 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.276600 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.277401 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.277404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.278396 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.278408 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.278919 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.278924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.279101 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.279707 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:25.279726 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:25.281475 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:25.283438 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:25.283444 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:25.283460 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:25.283741 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:25.284110 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:25.284113 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:25.284115 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:25.284307 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:25.284856 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:25.284865 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:25.285171 (+ 306us) client_negotiation.cc:769] Sending connection context
0810 06:34:25.285385 (+ 214us) client_negotiation.cc:240] Negotiation successful
0810 06:34:25.285827 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":130,"threads_started":1}
I20260810 06:34:25.288224 17793 heartbeater.cc:347] Connected to a master server at 127.21.195.254:37547
I20260810 06:34:25.288514 17793 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
I20260810 06:34:25.289143 17793 heartbeater.cc:511] Master 127.21.195.254:37547 requested a full tablet report, sending...
I20260810 06:34:25.290477 17285 ts_manager.cc:194] Registered new tserver with Master: 8ba30af888ae4dc782b9f8deeae310b6 (127.21.195.194:37681)
I20260810 06:34:25.291255 17285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:42803
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:34:25.306126 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37547
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:25.430748 17804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:25.431141 17804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:25.431219 17804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:25.435505 17804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:25.435590 17804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:25.435681 17804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:34:25.441499 17804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:25.442827 17804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:25.444033 17804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:25.455117 17821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:25.455152 17818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:25.455123 17819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:25.455448 17804 server_base.cc:1034] running on GCE node
I20260810 06:34:25.455982 17804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:25.456691 17804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:25.457847 17804 hybrid_clock.cc:648] HybridClock initialized: now 1786343665457814 us; error 49 us; skew 500 ppm
Aug 10 06:34:25 dist-test-slave-7lbf krb5kdc[17220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343665, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:25.460846 17804 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:34:25.461911 17804 webserver.cc:460] Webserver started at http://127.21.195.195:34813/ using document root <none> and password file <none>
I20260810 06:34:25.462554 17804 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:25.462633 17804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:25.462865 17804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:25.465226 17804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "810e084d52f24b52995f9c76f19b3b71"
format_stamp: "Formatted at 2026-08-10 06:34:25 on dist-test-slave-7lbf"
server_key: "df85307af666c34f729437450d18b4a2"
server_key_iv: "b465855269e26706239cab3006b9041d"
server_key_version: "encryptionkey@0"
I20260810 06:34:25.465893 17804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "810e084d52f24b52995f9c76f19b3b71"
format_stamp: "Formatted at 2026-08-10 06:34:25 on dist-test-slave-7lbf"
server_key: "df85307af666c34f729437450d18b4a2"
server_key_iv: "b465855269e26706239cab3006b9041d"
server_key_version: "encryptionkey@0"
I20260810 06:34:25.470129 17804 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:25.472934 17831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.474385 17804 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:25.474524 17804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "810e084d52f24b52995f9c76f19b3b71"
format_stamp: "Formatted at 2026-08-10 06:34:25 on dist-test-slave-7lbf"
server_key: "df85307af666c34f729437450d18b4a2"
server_key_iv: "b465855269e26706239cab3006b9041d"
server_key_version: "encryptionkey@0"
I20260810 06:34:25.474647 17804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:25.494136 17804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:25.497382 17804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:25.497632 17804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:25.498323 17804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:25.499305 17804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:25.499361 17804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.499431 17804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:25.499457 17804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:25.508960 17804 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:45509
I20260810 06:34:25.509007 18009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:45509 every 8 connection(s)
I20260810 06:34:25.510070 17804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:34:25.514683 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 17804
I20260810 06:34:25.514863 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:34:25.515228 22287 external_mini_cluster.cc:1428] Setting key f5af1a50dc4ce96558be1d6f27329e88
Aug 10 06:34:25 dist-test-slave-7lbf krb5kdc[17220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343665, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:25.525264 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.512169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:41053 (local address 127.21.195.254:37547)
0810 06:34:25.512335 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.512339 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.513311 (+ 972us) server_negotiation.cc:407] Connection header received
0810 06:34:25.514970 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.514975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.515039 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.515121 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:25.516961 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.517745 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.519000 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.519226 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.519299 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.522011 (+ 2712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:25.522014 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:25.522016 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:25.522045 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:25.523298 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:25.523822 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:25.523824 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:25.523826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:25.523909 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:25.524217 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:25.524219 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:25.524220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:25.524417 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:25.524491 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.525006 (+ 515us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.525129 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 06:34:25.526235 18014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.512613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37547 (local address 127.21.195.195:41053)
0810 06:34:25.513136 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.513187 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:25.514619 (+ 1432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:25.515381 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:25.515393 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:25.515970 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:25.516747 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.516815 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.517908 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.517912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.518878 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.518889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.519359 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.519362 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.519521 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.520153 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:25.520172 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:25.521822 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:25.523414 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:25.523420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:25.523438 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:25.523740 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:25.523978 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:25.523980 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:25.523981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:25.524147 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:25.524491 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:25.524497 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:25.524784 (+ 287us) client_negotiation.cc:769] Sending connection context
0810 06:34:25.524957 (+ 173us) client_negotiation.cc:240] Negotiation successful
0810 06:34:25.525259 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":128,"threads_started":1}
I20260810 06:34:25.527511 18010 heartbeater.cc:347] Connected to a master server at 127.21.195.254:37547
I20260810 06:34:25.527771 18010 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:25.528460 18010 heartbeater.cc:511] Master 127.21.195.254:37547 requested a full tablet report, sending...
I20260810 06:34:25.529692 17284 ts_manager.cc:194] Registered new tserver with Master: 810e084d52f24b52995f9c76f19b3b71 (127.21.195.195:45509)
I20260810 06:34:25.530336 17284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:41053
I20260810 06:34:25.541913 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:34:25.551545 17348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.544000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57892 (local address 127.21.195.254:37547)
0810 06:34:25.544168 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.544174 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.544297 (+ 123us) server_negotiation.cc:407] Connection header received
0810 06:34:25.544413 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.544415 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.544465 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.544522 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:25.545223 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.545788 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.546629 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.546880 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.546962 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.548388 (+ 1426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:25.548392 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:25.548394 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:25.548420 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:25.549681 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:25.550105 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:25.550108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:25.550109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:25.550197 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:25.550504 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:25.550508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:25.550510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:25.550779 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:25.550899 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.551219 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.551365 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 06:34:25.554957 17284 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57892:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:34:25.558395 17284 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:34:25.574909 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.568614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38348 (local address 127.21.195.195:45509)
0810 06:34:25.569080 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.569095 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.569465 (+ 370us) server_negotiation.cc:407] Connection header received
0810 06:34:25.569569 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.569575 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.569801 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.569976 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:25.570219 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.571388 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.573622 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.574318 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.574446 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.574579 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.574640 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.574741 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":130,"threads_started":1}
I20260810 06:34:25.574903 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.567777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:44195 (local address 127.0.0.1:41246)
0810 06:34:25.568208 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.568271 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:25.568409 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:25.569400 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:25.569407 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:25.569434 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:25.569647 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.569654 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.571326 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.571329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.572981 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.572993 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.574247 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.574251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.574394 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.574452 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 06:34:25.574571 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 06:34:25.574739 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":155,"thread_start_us":117,"threads_started":1}
I20260810 06:34:25.575099 18035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.568592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:37681 (local address 127.0.0.1:58014)
0810 06:34:25.569489 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.569502 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:25.569626 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:25.570157 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:25.570161 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:25.570178 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:25.570280 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.570285 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.571266 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.571270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.572806 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.572816 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.574239 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.574242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.574417 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.574481 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 06:34:25.574568 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 06:34:25.574998 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":427,"thread_start_us":100,"threads_started":1}
I20260810 06:34:25.575246 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.568881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58014 (local address 127.21.195.194:37681)
0810 06:34:25.569349 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.569361 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.569617 (+ 256us) server_negotiation.cc:407] Connection header received
0810 06:34:25.569726 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.569730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.569889 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.570019 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:25.570391 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.571135 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.572935 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.573873 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.574002 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.574173 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.574699 (+ 526us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.574803 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":134,"threads_started":1}
I20260810 06:34:25.574918 18036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.568395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45509 (local address 127.0.0.1:38348)
0810 06:34:25.569259 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.569273 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:25.569370 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:25.569963 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:25.569966 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:25.569983 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:25.570082 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.570088 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.571514 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.571517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.572981 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.572993 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.574437 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.574441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.574538 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.574557 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 06:34:25.574609 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:34:25.574733 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":104,"thread_start_us":114,"threads_started":1}
I20260810 06:34:25.575845 18034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.567881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41246 (local address 127.21.195.193:44195)
0810 06:34:25.568756 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.568766 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.568794 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:34:25.568928 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.568935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.569203 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.569817 (+ 614us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:25.569963 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.571180 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.573129 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.574099 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.574227 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.574358 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.575580 (+ 1222us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.575701 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":89,"threads_started":1}
I20260810 06:34:25.578615 17484 tablet_service.cc:1467] Processing CreateTablet for tablet e3ba9890da964701bc21192152586edc (DEFAULT_TABLE table=test-table [id=55de77ac06854ffbb0eeafbd0a0d306a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:25.578621 17686 tablet_service.cc:1467] Processing CreateTablet for tablet e3ba9890da964701bc21192152586edc (DEFAULT_TABLE table=test-table [id=55de77ac06854ffbb0eeafbd0a0d306a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:25.578621 17908 tablet_service.cc:1467] Processing CreateTablet for tablet e3ba9890da964701bc21192152586edc (DEFAULT_TABLE table=test-table [id=55de77ac06854ffbb0eeafbd0a0d306a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:25.579814 17686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3ba9890da964701bc21192152586edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:25.579814 17908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3ba9890da964701bc21192152586edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:25.579818 17484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3ba9890da964701bc21192152586edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:25.586756 18041 tablet_bootstrap.cc:492] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51: Bootstrap starting.
I20260810 06:34:25.589653 18041 tablet_bootstrap.cc:654] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:25.589918 18043 tablet_bootstrap.cc:492] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Bootstrap starting.
I20260810 06:34:25.590210 18042 tablet_bootstrap.cc:492] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: Bootstrap starting.
I20260810 06:34:25.591244 18041 log.cc:824] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:25.592274 18043 tablet_bootstrap.cc:654] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:25.592554 18042 tablet_bootstrap.cc:654] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:25.593470 18043 log.cc:824] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:25.593874 18041 tablet_bootstrap.cc:492] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51: No bootstrap required, opened a new log
I20260810 06:34:25.593948 18042 log.cc:824] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:25.594115 18041 ts_tablet_manager.cc:1397] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s
I20260810 06:34:25.595566 18043 tablet_bootstrap.cc:492] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: No bootstrap required, opened a new log
I20260810 06:34:25.595760 18043 ts_tablet_manager.cc:1397] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:34:25.596218 18042 tablet_bootstrap.cc:492] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: No bootstrap required, opened a new log
I20260810 06:34:25.596437 18042 ts_tablet_manager.cc:1397] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:34:25.599140 18043 raft_consensus.cc:348] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.599182 18041 raft_consensus.cc:348] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.599414 18043 raft_consensus.cc:374] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:25.599469 18043 raft_consensus.cc:729] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810e084d52f24b52995f9c76f19b3b71, State: Initialized, Role: FOLLOWER
I20260810 06:34:25.599519 18041 raft_consensus.cc:374] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:25.599596 18041 raft_consensus.cc:729] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99bc8d6706544036a89400e718a9bc51, State: Initialized, Role: FOLLOWER
I20260810 06:34:25.599974 18043 consensus_queue.cc:260] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.600136 18041 consensus_queue.cc:260] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.600374 18042 raft_consensus.cc:348] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.600718 18042 raft_consensus.cc:374] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:25.600818 18042 raft_consensus.cc:729] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba30af888ae4dc782b9f8deeae310b6, State: Initialized, Role: FOLLOWER
I20260810 06:34:25.600937 17590 heartbeater.cc:503] Master 127.21.195.254:37547 was elected leader, sending a full tablet report...
I20260810 06:34:25.601101 18043 ts_tablet_manager.cc:1428] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260810 06:34:25.601239 18041 ts_tablet_manager.cc:1428] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260810 06:34:25.601387 18042 consensus_queue.cc:260] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.601716 18010 heartbeater.cc:503] Master 127.21.195.254:37547 was elected leader, sending a full tablet report...
I20260810 06:34:25.603111 17793 heartbeater.cc:503] Master 127.21.195.254:37547 was elected leader, sending a full tablet report...
I20260810 06:34:25.603227 18042 ts_tablet_manager.cc:1428] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260810 06:34:25.721501 18048 raft_consensus.cc:482] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:25.721784 18048 raft_consensus.cc:504] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.723063 18048 leader_election.cc:288] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99bc8d6706544036a89400e718a9bc51 (127.21.195.193:44195), 8ba30af888ae4dc782b9f8deeae310b6 (127.21.195.194:37681)
I20260810 06:34:25.727177 18014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.723339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:44195 (local address 127.21.195.195:49849)
0810 06:34:25.723477 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.723491 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:25.723591 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:25.724030 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:25.724033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:25.724057 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:25.724166 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.724171 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.725182 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.725185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.726037 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.726047 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.726749 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.726752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.726862 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.726881 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 06:34:25.726946 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:34:25.727028 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260810 06:34:25.727177 18034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.723511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:49849 (local address 127.21.195.193:44195)
0810 06:34:25.723658 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.723663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.723682 (+ 19us) server_negotiation.cc:407] Connection header received
0810 06:34:25.723743 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.723746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.723794 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.723865 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:25.724270 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.725084 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.726189 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.726629 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.726748 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.726808 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.726982 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.727069 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 06:34:25.727349 18038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.723801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:53477 (local address 127.21.195.194:37681)
0810 06:34:25.723950 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.723955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.724114 (+ 159us) server_negotiation.cc:407] Connection header received
0810 06:34:25.724216 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.724219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.724272 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.724347 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:25.724564 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.725286 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.726422 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.726832 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.726950 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.727003 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.727169 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.727243 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:34:25.727361 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.723638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:37681 (local address 127.21.195.195:53477)
0810 06:34:25.724016 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.724029 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:25.724127 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:25.724352 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:25.724355 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:25.724367 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:25.724469 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.724473 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.725410 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.725413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.726290 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:25.726300 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.726950 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.726953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:25.727052 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.727075 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 06:34:25.727141 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 06:34:25.727212 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":12,"thread_start_us":169,"threads_started":1}
I20260810 06:34:25.727993 17723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3ba9890da964701bc21192152586edc" candidate_uuid: "810e084d52f24b52995f9c76f19b3b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba30af888ae4dc782b9f8deeae310b6" is_pre_election: true
I20260810 06:34:25.727993 17514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3ba9890da964701bc21192152586edc" candidate_uuid: "810e084d52f24b52995f9c76f19b3b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99bc8d6706544036a89400e718a9bc51" is_pre_election: true
I20260810 06:34:25.728307 17723 raft_consensus.cc:2454] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810e084d52f24b52995f9c76f19b3b71 in term 0.
I20260810 06:34:25.728309 17514 raft_consensus.cc:2454] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 810e084d52f24b52995f9c76f19b3b71 in term 0.
I20260810 06:34:25.728804 17838 leader_election.cc:302] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810e084d52f24b52995f9c76f19b3b71, 8ba30af888ae4dc782b9f8deeae310b6; no voters:
I20260810 06:34:25.729094 18048 raft_consensus.cc:2781] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:34:25.729177 18048 raft_consensus.cc:482] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:34:25.729208 18048 raft_consensus.cc:3037] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:25.730374 18048 raft_consensus.cc:504] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.730743 18048 leader_election.cc:288] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [CANDIDATE]: Term 1 election: Requested vote from peers 99bc8d6706544036a89400e718a9bc51 (127.21.195.193:44195), 8ba30af888ae4dc782b9f8deeae310b6 (127.21.195.194:37681)
I20260810 06:34:25.731190 17514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3ba9890da964701bc21192152586edc" candidate_uuid: "810e084d52f24b52995f9c76f19b3b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99bc8d6706544036a89400e718a9bc51"
I20260810 06:34:25.731222 17723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3ba9890da964701bc21192152586edc" candidate_uuid: "810e084d52f24b52995f9c76f19b3b71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ba30af888ae4dc782b9f8deeae310b6"
I20260810 06:34:25.731315 17514 raft_consensus.cc:3037] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:25.731353 17723 raft_consensus.cc:3037] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:25.732439 17514 raft_consensus.cc:2454] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810e084d52f24b52995f9c76f19b3b71 in term 1.
I20260810 06:34:25.732471 17723 raft_consensus.cc:2454] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 810e084d52f24b52995f9c76f19b3b71 in term 1.
I20260810 06:34:25.732753 17838 leader_election.cc:302] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810e084d52f24b52995f9c76f19b3b71, 8ba30af888ae4dc782b9f8deeae310b6; no voters:
I20260810 06:34:25.732972 18048 raft_consensus.cc:2781] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:25.733228 18048 raft_consensus.cc:686] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 1 LEADER]: Becoming Leader. State: Replica: 810e084d52f24b52995f9c76f19b3b71, State: Running, Role: LEADER
I20260810 06:34:25.733636 18048 consensus_queue.cc:237] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } }
I20260810 06:34:25.737324 17280 catalog_manager.cc:5495] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 810e084d52f24b52995f9c76f19b3b71 (127.21.195.195). New cstate: current_term: 1 leader_uuid: "810e084d52f24b52995f9c76f19b3b71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810e084d52f24b52995f9c76f19b3b71" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45509 } health_report { overall_health: HEALTHY } } }
W20260810 06:34:25.761162 18013 tablet.cc:2369] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:34:25.766605 18037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.762768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38352 (local address 127.21.195.195:45509)
0810 06:34:25.762925 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:25.762929 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:25.762946 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:34:25.763065 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:25.763067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:25.763131 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:25.763231 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:34:25.763502 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.764030 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.764910 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:25.765145 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:25.765241 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:25.765640 (+ 399us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:34:25.766144 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:34:25.766273 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:25.766347 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 06:34:25.766424 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260810 06:34:25.771818 17798 tablet.cc:2369] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:34:25.773464 17723 raft_consensus.cc:1261] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 1 FOLLOWER]: Refusing update from remote peer 810e084d52f24b52995f9c76f19b3b71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:25.773465 17514 raft_consensus.cc:1261] T e3ba9890da964701bc21192152586edc P 99bc8d6706544036a89400e718a9bc51 [term 1 FOLLOWER]: Refusing update from remote peer 810e084d52f24b52995f9c76f19b3b71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:25.774330 18055 consensus_queue.cc:1035] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ba30af888ae4dc782b9f8deeae310b6" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:25.774556 18048 consensus_queue.cc:1035] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99bc8d6706544036a89400e718a9bc51" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 44195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:25.782562 18059 mvcc.cc:205] Tried to move back new op lower bound from 7316863654998970368 to 7316863654847905792. Current Snapshot: MvccSnapshot[applied={T|T < 7316863654998970368}]
I20260810 06:34:25.783078 18060 mvcc.cc:205] Tried to move back new op lower bound from 7316863654998970368 to 7316863654847905792. Current Snapshot: MvccSnapshot[applied={T|T < 7316863654998970368}]
I20260810 06:34:25.792745 17280 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:25.792939 17280 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57892:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:25.795624 17280 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61816025be64472ebcd2b4a686d6ca5d: Sending DeleteTablet for 3 replicas of tablet e3ba9890da964701bc21192152586edc
I20260810 06:34:25.796644 17908 tablet_service.cc:1514] Processing DeleteTablet for tablet e3ba9890da964701bc21192152586edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:25 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:38348
I20260810 06:34:25.796654 17484 tablet_service.cc:1514] Processing DeleteTablet for tablet e3ba9890da964701bc21192152586edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:25 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:41246
I20260810 06:34:25.796905 17686 tablet_service.cc:1514] Processing DeleteTablet for tablet e3ba9890da964701bc21192152586edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:25 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:58014
I20260810 06:34:25.797429 18072 tablet_replica.cc:330] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: stopping tablet replica
I20260810 06:34:25.797501 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 17384
I20260810 06:34:25.797851 18072 raft_consensus.cc:2229] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:34:25.798390 18072 raft_consensus.cc:2258] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:25.809059 18072 ts_tablet_manager.cc:1905] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:25.811719 18072 ts_tablet_manager.cc:1918] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:25.811848 18072 log.cc:1196] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/e3ba9890da964701bc21192152586edc
I20260810 06:34:25.812233 18072 ts_tablet_manager.cc:1939] T e3ba9890da964701bc21192152586edc P 810e084d52f24b52995f9c76f19b3b71: Deleting consensus metadata
I20260810 06:34:25.812245 18073 tablet_replica.cc:330] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: stopping tablet replica
I20260810 06:34:25.812664 18073 raft_consensus.cc:2229] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:25.813185 18073 raft_consensus.cc:2258] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:25.814095 17263 catalog_manager.cc:4841] TS 810e084d52f24b52995f9c76f19b3b71 (127.21.195.195:45509): tablet e3ba9890da964701bc21192152586edc (table test-table [id=55de77ac06854ffbb0eeafbd0a0d306a]) successfully deleted
I20260810 06:34:25.814924 18073 ts_tablet_manager.cc:1905] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 06:34:25.816905 17265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:44195 (error 108)
I20260810 06:34:25.817677 18073 ts_tablet_manager.cc:1918] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:25.817799 18073 log.cc:1196] T e3ba9890da964701bc21192152586edc P 8ba30af888ae4dc782b9f8deeae310b6: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/e3ba9890da964701bc21192152586edc
I20260810 06:34:25.818217 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.817893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:44195 (local address 127.0.0.1:41256)
0810 06:34:25.818034 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.818119 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:44195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 06:34:25.818321 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 17595
W20260810 06:34:25.818425 17265 catalog_manager.cc:4584] TS 99bc8d6706544036a89400e718a9bc51 (127.21.195.193:44195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e3ba9890da964701bc21192152586edc: Network error: Client connection negotiation failed: client connection to 127.21.195.193:44195: connect: Connection refused (error 111)
I20260810 06:34:25.841820 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 17804
I20260810 06:34:25.845112 18033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:25.842063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:37681 (local address 127.0.0.1:58030)
0810 06:34:25.844913 (+ 2850us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:25.844995 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.194:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2715}
I20260810 06:34:25.863521 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 17236
2026-08-10T06:34:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2741 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T06:34:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:25Z Disabled control of system clock
I20260810 06:34:25.902179 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:41081
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:42721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:41081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:34:26.022476 18081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:26.022805 18081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:26.022842 18081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:26.027060 18081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:26.027146 18081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:26.027161 18081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:26.027177 18081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:26.027191 18081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:26.032419 18081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:41081
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:41081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:26.033775 18081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:26.035327 18081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:26.044881 18088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:26.044893 18087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:26.044898 18090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:26.045061 18081 server_base.cc:1034] running on GCE node
I20260810 06:34:26.045915 18081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:26.047174 18081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:26.048381 18081 hybrid_clock.cc:648] HybridClock initialized: now 1786343666048354 us; error 43 us; skew 500 ppm
I20260810 06:34:26.050531 18081 webserver.cc:460] Webserver started at http://127.21.195.254:39951/ using document root <none> and password file <none>
I20260810 06:34:26.051208 18081 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:26.051283 18081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:26.051563 18081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:26.053936 18081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "4d1251c55329402a8c959ac34e3aaa05"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "fe9fcbf76cc9481cc4bd7c0d61702d71"
server_key_iv: "4199ddb6aef4e773038a074c509779d2"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.054579 18081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "4d1251c55329402a8c959ac34e3aaa05"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "fe9fcbf76cc9481cc4bd7c0d61702d71"
server_key_iv: "4199ddb6aef4e773038a074c509779d2"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.058673 18081 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:26.061363 18099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.062743 18081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:26.062893 18081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "4d1251c55329402a8c959ac34e3aaa05"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "fe9fcbf76cc9481cc4bd7c0d61702d71"
server_key_iv: "4199ddb6aef4e773038a074c509779d2"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.063010 18081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:26.090659 18081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:26.091537 18081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:26.091758 18081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:26.099323 18081 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:41081
I20260810 06:34:26.099327 18182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:41081 every 8 connection(s)
I20260810 06:34:26.100410 18081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:26.103951 18183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:26.109180 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 18081
I20260810 06:34:26.109330 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:26.109686 22287 external_mini_cluster.cc:1428] Setting key d4b5e1dd46e36236ee9756274b5a075b
I20260810 06:34:26.110868 18183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05: Bootstrap starting.
I20260810 06:34:26.113582 18183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:26.114447 18183 log.cc:824] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:26.116554 18183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05: No bootstrap required, opened a new log
I20260810 06:34:26.119714 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.111304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48948 (local address 127.21.195.254:41081)
0810 06:34:26.112068 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:26.112086 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:26.112126 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:34:26.112833 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:26.112853 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:26.113314 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:26.113712 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:26.114225 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.115273 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.116201 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.116734 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.116908 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.117830 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:26.117836 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:26.117851 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:26.118269 (+ 418us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:26.118336 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:26.118358 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:26.118449 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:26.118604 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 06:34:26.118904 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":164,"threads_started":1}
I20260810 06:34:26.120733 18183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d1251c55329402a8c959ac34e3aaa05" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41081 } }
I20260810 06:34:26.121047 18183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:26.121124 18183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d1251c55329402a8c959ac34e3aaa05, State: Initialized, Role: FOLLOWER
I20260810 06:34:26.121627 18183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d1251c55329402a8c959ac34e3aaa05" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41081 } }
I20260810 06:34:26.121778 18183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:26.121845 18183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:26.121948 18183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:26.123072 18183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d1251c55329402a8c959ac34e3aaa05" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41081 } }
I20260810 06:34:26.123437 18183 leader_election.cc:302] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d1251c55329402a8c959ac34e3aaa05; no voters:
I20260810 06:34:26.123761 18183 leader_election.cc:288] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:26.123936 18192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:26.124155 18192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [term 1 LEADER]: Becoming Leader. State: Replica: 4d1251c55329402a8c959ac34e3aaa05, State: Running, Role: LEADER
I20260810 06:34:26.124483 18192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d1251c55329402a8c959ac34e3aaa05" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41081 } }
I20260810 06:34:26.125056 18183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:26.126186 18194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d1251c55329402a8c959ac34e3aaa05. Latest consensus state: current_term: 1 leader_uuid: "4d1251c55329402a8c959ac34e3aaa05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d1251c55329402a8c959ac34e3aaa05" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41081 } } }
I20260810 06:34:26.126323 18194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:26.126648 18193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d1251c55329402a8c959ac34e3aaa05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d1251c55329402a8c959ac34e3aaa05" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41081 } } }
I20260810 06:34:26.126775 18206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:26.126816 18193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:26.130476 18206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:26.136758 18206 catalog_manager.cc:1347] Generated new cluster ID: 3ba086808f6344c9a25d18e3e3d3d7fb
I20260810 06:34:26.136860 18206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:26.151489 18206 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:26.152971 18206 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:26.161806 18206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05: Generated new TSK 0
I20260810 06:34:26.162918 18206 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:26.166953 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41081
--builtin_ntp_servers=127.21.195.212:42721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:34:26.294570 18224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:26.294880 18224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:26.294922 18224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:26.299125 18224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:26.299196 18224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:26.299265 18224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:34:26.304337 18224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:26.305665 18224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:26.307292 18224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:26.317912 18239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:26.317961 18245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:26.317910 18234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:26.318171 18224 server_base.cc:1034] running on GCE node
I20260810 06:34:26.318684 18224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:26.319416 18224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:26.320605 18224 hybrid_clock.cc:648] HybridClock initialized: now 1786343666320593 us; error 37 us; skew 500 ppm
I20260810 06:34:26.322717 18224 webserver.cc:460] Webserver started at http://127.21.195.193:46183/ using document root <none> and password file <none>
I20260810 06:34:26.323355 18224 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:26.323432 18224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:26.323666 18224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:26.326118 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "61ff4668253b4cb28b341d58c0f3f080"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "c989eeb73ed3ea8172d7b63dfbc82dbe"
server_key_iv: "6c8d260f435084ff46098e4d266fe304"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.326757 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "61ff4668253b4cb28b341d58c0f3f080"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "c989eeb73ed3ea8172d7b63dfbc82dbe"
server_key_iv: "6c8d260f435084ff46098e4d266fe304"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.330935 18224 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260810 06:34:26.333631 18252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.335088 18224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:34:26.335203 18224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "61ff4668253b4cb28b341d58c0f3f080"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "c989eeb73ed3ea8172d7b63dfbc82dbe"
server_key_iv: "6c8d260f435084ff46098e4d266fe304"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.335310 18224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:26.357223 18224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:26.358119 18224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:26.358297 18224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:26.358927 18224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:26.359987 18224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:26.360037 18224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.360080 18224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:26.360100 18224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.369176 18224 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:33429
I20260810 06:34:26.369243 18443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:33429 every 8 connection(s)
I20260810 06:34:26.370245 18224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:34:26.379357 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 18224
I20260810 06:34:26.379510 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:34:26.379828 22287 external_mini_cluster.cc:1428] Setting key e3a3c49d14f9c0ab58fd9c17d1e20794
I20260810 06:34:26.380858 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.372330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:59715 (local address 127.21.195.254:41081)
0810 06:34:26.372514 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:26.372519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:26.373775 (+ 1256us) server_negotiation.cc:407] Connection header received
0810 06:34:26.375325 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:26.375328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:26.375384 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:26.375450 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:26.376682 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.377255 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.378552 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.378794 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.378901 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.380311 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:26.380315 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:26.380318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:26.380335 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:26.380366 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:26.380378 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:26.380457 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:26.380622 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 06:34:26.380687 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260810 06:34:26.382128 18447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.372850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41081 (local address 127.21.195.193:59715)
0810 06:34:26.373614 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:26.373662 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:26.375058 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:26.375681 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:26.375692 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:26.375824 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:26.376508 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.376527 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.377389 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.377392 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.378417 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.378429 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.378982 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.378986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.379202 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.379945 (+ 743us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:26.379947 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:26.380015 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:26.380113 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:26.380461 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:26.380469 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:26.380474 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:34:26.380618 (+ 144us) client_negotiation.cc:240] Negotiation successful
0810 06:34:26.380957 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":111,"threads_started":1}
I20260810 06:34:26.382248 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41081
--builtin_ntp_servers=127.21.195.212:42721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:34:26.384157 18444 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41081
I20260810 06:34:26.384428 18444 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:26.385010 18444 heartbeater.cc:511] Master 127.21.195.254:41081 requested a full tablet report, sending...
I20260810 06:34:26.386723 18127 ts_manager.cc:194] Registered new tserver with Master: 61ff4668253b4cb28b341d58c0f3f080 (127.21.195.193:33429)
I20260810 06:34:26.388012 18127 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.193:59715
W20260810 06:34:26.505043 18450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:26.505379 18450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:26.505441 18450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:26.509630 18450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:26.509734 18450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:26.509809 18450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:34:26.514825 18450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:26.516003 18450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:26.517474 18450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:26.528219 18467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:26.528276 18464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:26.528220 18462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:26.528661 18450 server_base.cc:1034] running on GCE node
I20260810 06:34:26.529095 18450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:26.529851 18450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:26.531028 18450 hybrid_clock.cc:648] HybridClock initialized: now 1786343666531001 us; error 40 us; skew 500 ppm
I20260810 06:34:26.533083 18450 webserver.cc:460] Webserver started at http://127.21.195.194:40751/ using document root <none> and password file <none>
I20260810 06:34:26.533788 18450 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:26.533880 18450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:26.534112 18450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:26.536396 18450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "a8215e3c993a4752b02853fa1e7b4c09"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "8832286cbc577c894b18536b26a63292"
server_key_iv: "d9a2d944728aa95e94a0031f2e534ca8"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.537050 18450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "a8215e3c993a4752b02853fa1e7b4c09"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "8832286cbc577c894b18536b26a63292"
server_key_iv: "d9a2d944728aa95e94a0031f2e534ca8"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.541312 18450 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 06:34:26.544091 18479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.545428 18450 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:34:26.545580 18450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "a8215e3c993a4752b02853fa1e7b4c09"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "8832286cbc577c894b18536b26a63292"
server_key_iv: "d9a2d944728aa95e94a0031f2e534ca8"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.545696 18450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:26.566275 18450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:26.567165 18450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:26.567385 18450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:26.568109 18450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:26.569260 18450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:26.569315 18450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.569389 18450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:26.569415 18450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.578773 18450 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:33007
I20260810 06:34:26.578850 18655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:33007 every 8 connection(s)
I20260810 06:34:26.579820 18450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:34:26.581079 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 18450
I20260810 06:34:26.581179 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:34:26.581444 22287 external_mini_cluster.cc:1428] Setting key a2180246967d56a3613279410c8c18b8
I20260810 06:34:26.583688 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41081
--builtin_ntp_servers=127.21.195.212:42721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:34:26.591166 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.581839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:43647 (local address 127.21.195.254:41081)
0810 06:34:26.582006 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:26.582011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:26.583460 (+ 1449us) server_negotiation.cc:407] Connection header received
0810 06:34:26.584969 (+ 1509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:26.584973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:26.585032 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:26.585117 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:26.586551 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.587108 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.588800 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.589107 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.589203 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.590655 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:26.590658 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:26.590661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:26.590675 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:26.590696 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:26.590704 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:26.590762 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:26.590953 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 06:34:26.591012 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 06:34:26.592571 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.582420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41081 (local address 127.21.195.194:43647)
0810 06:34:26.583322 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:26.583371 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:26.584726 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:26.585374 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:26.585386 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:26.585545 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:26.586362 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.586385 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.587263 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.587267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.588651 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.588665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.589290 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.589296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.589567 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.590275 (+ 708us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:26.590278 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:26.590347 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:26.590453 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:26.590786 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:26.590797 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:26.590804 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:34:26.590966 (+ 162us) client_negotiation.cc:240] Negotiation successful
0810 06:34:26.591369 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":140,"threads_started":1}
I20260810 06:34:26.593935 18656 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41081
I20260810 06:34:26.594204 18656 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:26.594791 18656 heartbeater.cc:511] Master 127.21.195.254:41081 requested a full tablet report, sending...
I20260810 06:34:26.596035 18127 ts_manager.cc:194] Registered new tserver with Master: a8215e3c993a4752b02853fa1e7b4c09 (127.21.195.194:33007)
I20260810 06:34:26.596885 18127 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.194:43647
W20260810 06:34:26.711477 18661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:26.711800 18661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:26.711840 18661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:26.716197 18661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:26.716282 18661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:26.716351 18661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:34:26.721453 18661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:41081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:26.722738 18661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:26.724328 18661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:34:26.735791 18661 server_base.cc:1034] running on GCE node
W20260810 06:34:26.735733 18673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:26.735733 18677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:26.735738 18672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:26.736435 18661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:26.737182 18661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:26.738376 18661 hybrid_clock.cc:648] HybridClock initialized: now 1786343666738348 us; error 42 us; skew 500 ppm
I20260810 06:34:26.740494 18661 webserver.cc:460] Webserver started at http://127.21.195.195:44445/ using document root <none> and password file <none>
I20260810 06:34:26.741140 18661 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:26.741216 18661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:26.741452 18661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:26.743826 18661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "1866ecc192454913b51b8c5f19221f32"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "da5b7744f22d054b5548b0ca34c3d425"
server_key_iv: "1e699dd6ca3ed33ba22eb519d8986ca8"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.744478 18661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "1866ecc192454913b51b8c5f19221f32"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "da5b7744f22d054b5548b0ca34c3d425"
server_key_iv: "1e699dd6ca3ed33ba22eb519d8986ca8"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.748821 18661 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 06:34:26.751858 18691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.753360 18661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:34:26.753500 18661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "1866ecc192454913b51b8c5f19221f32"
format_stamp: "Formatted at 2026-08-10 06:34:26 on dist-test-slave-7lbf"
server_key: "da5b7744f22d054b5548b0ca34c3d425"
server_key_iv: "1e699dd6ca3ed33ba22eb519d8986ca8"
server_key_version: "encryptionkey@0"
I20260810 06:34:26.753676 18661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:26.802037 18661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:26.802868 18661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:26.803071 18661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:26.803764 18661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:26.804877 18661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:26.804941 18661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.805003 18661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:26.805032 18661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:26.814291 18661 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:46119
I20260810 06:34:26.814314 18864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:46119 every 8 connection(s)
I20260810 06:34:26.815339 18661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:34:26.823271 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 18661
I20260810 06:34:26.823378 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:34:26.823661 22287 external_mini_cluster.cc:1428] Setting key f0715d6ed8072f617f629ae01ee9fe0f
I20260810 06:34:26.825799 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.817436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:36105 (local address 127.21.195.254:41081)
0810 06:34:26.817645 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:26.817649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:26.818927 (+ 1278us) server_negotiation.cc:407] Connection header received
0810 06:34:26.820468 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:26.820472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:26.820540 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:26.820618 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:26.821730 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.822279 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.823536 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.823790 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.823902 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.825227 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:26.825231 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:26.825233 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:26.825247 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:26.825272 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:26.825281 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:26.825351 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:26.825548 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 06:34:26.825626 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260810 06:34:26.826871 18869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.817952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41081 (local address 127.21.195.195:36105)
0810 06:34:26.818695 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:26.818742 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:26.820191 (+ 1449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:26.820848 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:26.820856 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:26.820964 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:26.821568 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.821586 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.822421 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.822424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.823393 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.823408 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.823953 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.823957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.824154 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.824922 (+ 768us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:26.824924 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:26.824977 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:26.825077 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:26.825360 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:26.825370 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:26.825378 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 06:34:26.825507 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 06:34:26.825916 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":125,"threads_started":1}
I20260810 06:34:26.828030 18865 heartbeater.cc:347] Connected to a master server at 127.21.195.254:41081
I20260810 06:34:26.828297 18865 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:26.828874 18865 heartbeater.cc:511] Master 127.21.195.254:41081 requested a full tablet report, sending...
I20260810 06:34:26.830044 18127 ts_manager.cc:194] Registered new tserver with Master: 1866ecc192454913b51b8c5f19221f32 (127.21.195.195:46119)
I20260810 06:34:26.830657 18127 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.195:36105
I20260810 06:34:26.838201 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:34:26.844316 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.840407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48962 (local address 127.21.195.254:41081)
0810 06:34:26.840548 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:26.840553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:26.840667 (+ 114us) server_negotiation.cc:407] Connection header received
0810 06:34:26.840810 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:26.840813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:26.840863 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:26.840933 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:26.841234 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.841852 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.842748 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.842979 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.843072 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.843869 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:26.843874 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:26.843876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:26.843891 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:26.843914 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:26.843923 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:26.843996 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:26.844088 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 06:34:26.844154 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:34:26.847438 18127 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:34:26.850968 18127 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:34:26.866839 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.860613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36224 (local address 127.21.195.193:33429)
0810 06:34:26.861317 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:26.861324 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:26.861354 (+ 30us) server_negotiation.cc:407] Connection header received
0810 06:34:26.861438 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:26.861444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:26.861726 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:26.861908 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:26.862432 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.863613 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.865459 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.866112 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.866234 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.866457 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:26.866548 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 06:34:26.866654 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":590,"thread_start_us":100,"threads_started":1}
I20260810 06:34:26.866847 18886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.860490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:33429 (local address 127.0.0.1:36224)
0810 06:34:26.860942 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:26.860996 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:26.861127 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:26.862108 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:26.862115 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:26.862140 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:26.862285 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.862293 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.863706 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.863709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.865317 (+ 1608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.865324 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.866230 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.866234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.866349 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.866388 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 06:34:26.866507 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 06:34:26.866650 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":143,"thread_start_us":84,"threads_started":1}
I20260810 06:34:26.866863 18882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.860528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:33007 (local address 127.0.0.1:54250)
0810 06:34:26.861260 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:26.861274 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:26.861376 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:26.862461 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:26.862463 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:26.862480 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:26.862587 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.862594 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.863670 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.863674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.865306 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.865319 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.866432 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.866435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.866537 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.866560 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 06:34:26.866612 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:34:26.866703 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":141,"thread_start_us":129,"threads_started":1}
I20260810 06:34:26.867262 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.861999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35004 (local address 127.21.195.195:46119)
0810 06:34:26.862507 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:26.862520 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:26.862544 (+ 24us) server_negotiation.cc:407] Connection header received
0810 06:34:26.862615 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:26.862619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:26.862802 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:26.862956 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:26.863168 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.864088 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.865364 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.866234 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.866363 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.866562 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:26.866978 (+ 416us) server_negotiation.cc:299] Negotiation successful
0810 06:34:26.867092 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":158,"threads_started":1}
I20260810 06:34:26.867570 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.861633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:46119 (local address 127.0.0.1:35004)
0810 06:34:26.862208 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:26.862222 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:26.862303 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:26.862946 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:26.862950 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:26.862969 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:26.863052 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.863058 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.864219 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.864222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.865230 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:26.865246 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.866623 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.866626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:26.866728 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.866747 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 06:34:26.866809 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 06:34:26.867415 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":18,"thread_start_us":100,"threads_started":1}
I20260810 06:34:26.870077 18888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:26.861602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54250 (local address 127.21.195.194:33007)
0810 06:34:26.861951 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:26.861963 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:26.861986 (+ 23us) server_negotiation.cc:407] Connection header received
0810 06:34:26.862062 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:26.862067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:26.862274 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:26.862489 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:26.862686 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.863564 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.865419 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:26.866295 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:26.869631 (+ 3336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:26.869798 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:26.869846 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 06:34:26.869933 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":111,"threads_started":1}
I20260810 06:34:26.870973 18769 tablet_service.cc:1467] Processing CreateTablet for tablet 4a309b19ce2e45ce9c1698a7bfd58d69 (DEFAULT_TABLE table=test-table [id=df424bcbe2c4404eb1b8cc922d4d0a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:26.870971 18339 tablet_service.cc:1467] Processing CreateTablet for tablet 4a309b19ce2e45ce9c1698a7bfd58d69 (DEFAULT_TABLE table=test-table [id=df424bcbe2c4404eb1b8cc922d4d0a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:26.872308 18769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a309b19ce2e45ce9c1698a7bfd58d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:26.872308 18339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a309b19ce2e45ce9c1698a7bfd58d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:26.879577 18549 tablet_service.cc:1467] Processing CreateTablet for tablet 4a309b19ce2e45ce9c1698a7bfd58d69 (DEFAULT_TABLE table=test-table [id=df424bcbe2c4404eb1b8cc922d4d0a6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:26.880787 18549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a309b19ce2e45ce9c1698a7bfd58d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:26.881248 18893 tablet_bootstrap.cc:492] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Bootstrap starting.
I20260810 06:34:26.880759 18894 tablet_bootstrap.cc:492] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080: Bootstrap starting.
I20260810 06:34:26.884028 18893 tablet_bootstrap.cc:654] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:26.884056 18894 tablet_bootstrap.cc:654] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:26.884827 18893 log.cc:824] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:26.884899 18894 log.cc:824] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:26.887245 18893 tablet_bootstrap.cc:492] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: No bootstrap required, opened a new log
I20260810 06:34:26.887501 18893 ts_tablet_manager.cc:1397] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:34:26.888800 18894 tablet_bootstrap.cc:492] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080: No bootstrap required, opened a new log
I20260810 06:34:26.889034 18894 ts_tablet_manager.cc:1397] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260810 06:34:26.889436 18898 tablet_bootstrap.cc:492] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: Bootstrap starting.
I20260810 06:34:26.891819 18893 raft_consensus.cc:348] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:26.892076 18893 raft_consensus.cc:374] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:26.892132 18893 raft_consensus.cc:729] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1866ecc192454913b51b8c5f19221f32, State: Initialized, Role: FOLLOWER
I20260810 06:34:26.892177 18898 tablet_bootstrap.cc:654] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:26.892592 18893 consensus_queue.cc:260] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:26.893110 18898 log.cc:824] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:26.893307 18865 heartbeater.cc:503] Master 127.21.195.254:41081 was elected leader, sending a full tablet report...
I20260810 06:34:26.893913 18894 raft_consensus.cc:348] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:26.894222 18894 raft_consensus.cc:374] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:26.894281 18894 raft_consensus.cc:729] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61ff4668253b4cb28b341d58c0f3f080, State: Initialized, Role: FOLLOWER
I20260810 06:34:26.894747 18894 consensus_queue.cc:260] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:26.894889 18893 ts_tablet_manager.cc:1428] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 06:34:26.895589 18444 heartbeater.cc:503] Master 127.21.195.254:41081 was elected leader, sending a full tablet report...
I20260810 06:34:26.895840 18894 ts_tablet_manager.cc:1428] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 06:34:26.895889 18898 tablet_bootstrap.cc:492] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: No bootstrap required, opened a new log
I20260810 06:34:26.896096 18898 ts_tablet_manager.cc:1397] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260810 06:34:26.900696 18898 raft_consensus.cc:348] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:26.900974 18898 raft_consensus.cc:374] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:26.901037 18898 raft_consensus.cc:729] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8215e3c993a4752b02853fa1e7b4c09, State: Initialized, Role: FOLLOWER
I20260810 06:34:26.901486 18898 consensus_queue.cc:260] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:26.902261 18656 heartbeater.cc:503] Master 127.21.195.254:41081 was elected leader, sending a full tablet report...
I20260810 06:34:26.902637 18898 ts_tablet_manager.cc:1428] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:34:27.015038 18906 raft_consensus.cc:482] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:27.015292 18906 raft_consensus.cc:504] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:27.016687 18906 leader_election.cc:288] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61ff4668253b4cb28b341d58c0f3f080 (127.21.195.193:33429), 1866ecc192454913b51b8c5f19221f32 (127.21.195.195:46119)
I20260810 06:34:27.020754 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:27.017140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:58301 (local address 127.21.195.195:46119)
0810 06:34:27.017264 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:27.017268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:27.017329 (+ 61us) server_negotiation.cc:407] Connection header received
0810 06:34:27.017499 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:27.017503 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:27.017589 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:27.017680 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:27.017990 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.018602 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.019768 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.020176 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.020280 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:27.020336 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:27.020545 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 06:34:27.020620 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 06:34:27.020767 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:27.017122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:38667 (local address 127.21.195.193:33429)
0810 06:34:27.017255 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:27.017260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:27.017631 (+ 371us) server_negotiation.cc:407] Connection header received
0810 06:34:27.017749 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:27.017752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:27.017805 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:27.017899 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:27.018180 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.018657 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.019775 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.020203 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.020323 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:27.020374 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:27.020570 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 06:34:27.020659 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 06:34:27.020757 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:27.017001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:46119 (local address 127.21.195.194:58301)
0810 06:34:27.017249 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:27.017264 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:27.017380 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:27.017715 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:27.017718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:27.017736 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:27.017870 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:27.017878 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.018732 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.018736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:27.019630 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:27.019641 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.020303 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.020307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:27.020419 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:27.020446 (+ 27us) client_negotiation.cc:769] Sending connection context
0810 06:34:27.020506 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 06:34:27.020593 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":24}
I20260810 06:34:27.020766 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:27.017001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:33429 (local address 127.21.195.194:38667)
0810 06:34:27.017498 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:27.017534 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:27.017652 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:27.017909 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:27.017912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:27.017928 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:27.018065 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:27.018071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.018777 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.018780 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:27.019631 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:27.019640 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.020343 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.020347 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:27.020448 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:27.020465 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 06:34:27.020536 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:34:27.020605 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"mutex_wait_us":70,"thread_start_us":147,"threads_started":1}
I20260810 06:34:27.021620 18795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a309b19ce2e45ce9c1698a7bfd58d69" candidate_uuid: "a8215e3c993a4752b02853fa1e7b4c09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1866ecc192454913b51b8c5f19221f32" is_pre_election: true
I20260810 06:34:27.021665 18362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a309b19ce2e45ce9c1698a7bfd58d69" candidate_uuid: "a8215e3c993a4752b02853fa1e7b4c09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61ff4668253b4cb28b341d58c0f3f080" is_pre_election: true
I20260810 06:34:27.021951 18362 raft_consensus.cc:2454] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8215e3c993a4752b02853fa1e7b4c09 in term 0.
I20260810 06:34:27.021952 18795 raft_consensus.cc:2454] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8215e3c993a4752b02853fa1e7b4c09 in term 0.
I20260810 06:34:27.022465 18486 leader_election.cc:302] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61ff4668253b4cb28b341d58c0f3f080, a8215e3c993a4752b02853fa1e7b4c09; no voters:
I20260810 06:34:27.022747 18906 raft_consensus.cc:2781] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:34:27.022831 18906 raft_consensus.cc:482] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:34:27.022863 18906 raft_consensus.cc:3037] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:27.023967 18906 raft_consensus.cc:504] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:27.024340 18906 leader_election.cc:288] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [CANDIDATE]: Term 1 election: Requested vote from peers 61ff4668253b4cb28b341d58c0f3f080 (127.21.195.193:33429), 1866ecc192454913b51b8c5f19221f32 (127.21.195.195:46119)
I20260810 06:34:27.024750 18362 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a309b19ce2e45ce9c1698a7bfd58d69" candidate_uuid: "a8215e3c993a4752b02853fa1e7b4c09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61ff4668253b4cb28b341d58c0f3f080"
I20260810 06:34:27.024793 18795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a309b19ce2e45ce9c1698a7bfd58d69" candidate_uuid: "a8215e3c993a4752b02853fa1e7b4c09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1866ecc192454913b51b8c5f19221f32"
I20260810 06:34:27.024889 18362 raft_consensus.cc:3037] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:27.024912 18795 raft_consensus.cc:3037] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:27.026147 18795 raft_consensus.cc:2454] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8215e3c993a4752b02853fa1e7b4c09 in term 1.
I20260810 06:34:27.026183 18362 raft_consensus.cc:2454] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8215e3c993a4752b02853fa1e7b4c09 in term 1.
I20260810 06:34:27.026503 18486 leader_election.cc:302] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61ff4668253b4cb28b341d58c0f3f080, a8215e3c993a4752b02853fa1e7b4c09; no voters:
I20260810 06:34:27.026683 18906 raft_consensus.cc:2781] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:27.026929 18906 raft_consensus.cc:686] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 1 LEADER]: Becoming Leader. State: Replica: a8215e3c993a4752b02853fa1e7b4c09, State: Running, Role: LEADER
I20260810 06:34:27.027354 18906 consensus_queue.cc:237] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } }
I20260810 06:34:27.030931 18124 catalog_manager.cc:5495] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8215e3c993a4752b02853fa1e7b4c09 (127.21.195.194). New cstate: current_term: 1 leader_uuid: "a8215e3c993a4752b02853fa1e7b4c09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8215e3c993a4752b02853fa1e7b4c09" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 33007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 } health_report { overall_health: UNKNOWN } } }
I20260810 06:34:27.059096 18888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:27.055475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54260 (local address 127.21.195.194:33007)
0810 06:34:27.055606 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:27.055610 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:27.055642 (+ 32us) server_negotiation.cc:407] Connection header received
0810 06:34:27.055731 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:27.055734 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:27.055792 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:27.055911 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:34:27.056148 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.056660 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.057565 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:27.057787 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:27.057878 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:27.058213 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:34:27.058687 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:34:27.058808 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:27.058876 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 06:34:27.058946 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:34:27.065693 18795 raft_consensus.cc:1261] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 1 FOLLOWER]: Refusing update from remote peer a8215e3c993a4752b02853fa1e7b4c09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:27.065693 18362 raft_consensus.cc:1261] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 1 FOLLOWER]: Refusing update from remote peer a8215e3c993a4752b02853fa1e7b4c09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 06:34:27.066315 18868 tablet.cc:2369] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:34:27.066540 18911 consensus_queue.cc:1035] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1866ecc192454913b51b8c5f19221f32" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 46119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:27.066879 18906 consensus_queue.cc:1035] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61ff4668253b4cb28b341d58c0f3f080" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:27.075654 18915 mvcc.cc:205] Tried to move back new op lower bound from 7316863660292771840 to 7316863660146978816. Current Snapshot: MvccSnapshot[applied={T|T < 7316863660292771840}]
I20260810 06:34:27.078141 18917 mvcc.cc:205] Tried to move back new op lower bound from 7316863660292771840 to 7316863660146978816. Current Snapshot: MvccSnapshot[applied={T|T < 7316863660292771840}]
I20260810 06:34:27.078141 18914 mvcc.cc:205] Tried to move back new op lower bound from 7316863660292771840 to 7316863660146978816. Current Snapshot: MvccSnapshot[applied={T|T < 7316863660292771840 or (T in {7316863660292771840})}]
I20260810 06:34:27.084797 18127 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:27.085035 18127 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:27.088042 18127 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4d1251c55329402a8c959ac34e3aaa05: Sending DeleteTablet for 3 replicas of tablet 4a309b19ce2e45ce9c1698a7bfd58d69
I20260810 06:34:27.088961 18339 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a309b19ce2e45ce9c1698a7bfd58d69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:27 UTC) from {username='slave'} at 127.0.0.1:36224
I20260810 06:34:27.089012 18769 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a309b19ce2e45ce9c1698a7bfd58d69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:27 UTC) from {username='slave'} at 127.0.0.1:35004
I20260810 06:34:27.089043 18549 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a309b19ce2e45ce9c1698a7bfd58d69 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:27 UTC) from {username='slave'} at 127.0.0.1:54250
I20260810 06:34:27.089613 18935 tablet_replica.cc:330] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: stopping tablet replica
I20260810 06:34:27.089634 18942 tablet_replica.cc:330] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080: stopping tablet replica
I20260810 06:34:27.090032 18942 raft_consensus.cc:2229] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:27.090030 18935 raft_consensus.cc:2229] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:34:27.090255 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 18224
I20260810 06:34:27.090431 18942 raft_consensus.cc:2258] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 61ff4668253b4cb28b341d58c0f3f080 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:27.090679 18935 raft_consensus.cc:2258] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:27.090915 18939 tablet_replica.cc:330] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: stopping tablet replica
I20260810 06:34:27.091609 18939 raft_consensus.cc:2229] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:27.091984 18939 raft_consensus.cc:2258] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:27.095585 18935 ts_tablet_manager.cc:1905] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:27.095587 18939 ts_tablet_manager.cc:1905] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:27.098634 18939 ts_tablet_manager.cc:1918] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:27.098759 18939 log.cc:1196] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/4a309b19ce2e45ce9c1698a7bfd58d69
I20260810 06:34:27.099107 18939 ts_tablet_manager.cc:1939] T 4a309b19ce2e45ce9c1698a7bfd58d69 P 1866ecc192454913b51b8c5f19221f32: Deleting consensus metadata
I20260810 06:34:27.099336 18935 ts_tablet_manager.cc:1918] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:27.099522 18935 log.cc:1196] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/4a309b19ce2e45ce9c1698a7bfd58d69
I20260810 06:34:27.099943 18935 ts_tablet_manager.cc:1939] T 4a309b19ce2e45ce9c1698a7bfd58d69 P a8215e3c993a4752b02853fa1e7b4c09: Deleting consensus metadata
I20260810 06:34:27.101642 18104 catalog_manager.cc:4841] TS a8215e3c993a4752b02853fa1e7b4c09 (127.21.195.194:33007): tablet 4a309b19ce2e45ce9c1698a7bfd58d69 (table test-table [id=df424bcbe2c4404eb1b8cc922d4d0a6c]) successfully deleted
I20260810 06:34:27.102150 18100 catalog_manager.cc:4841] TS 1866ecc192454913b51b8c5f19221f32 (127.21.195.195:46119): tablet 4a309b19ce2e45ce9c1698a7bfd58d69 (table test-table [id=df424bcbe2c4404eb1b8cc922d4d0a6c]) successfully deleted
W20260810 06:34:27.112043 18105 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:33429 (error 108)
I20260810 06:34:27.113198 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:27.112891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:33429 (local address 127.0.0.1:36230)
0810 06:34:27.113028 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:27.113105 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:33429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 06:34:27.113379 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 18450
W20260810 06:34:27.116304 18105 catalog_manager.cc:4584] TS 61ff4668253b4cb28b341d58c0f3f080 (127.21.195.193:33429): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a309b19ce2e45ce9c1698a7bfd58d69: Network error: Client connection negotiation failed: client connection to 127.21.195.193:33429: connect: Connection refused (error 111)
I20260810 06:34:27.135499 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 18661
I20260810 06:34:27.151434 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 18081
2026-08-10T06:34:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1296 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:27 dist-test-slave-7lbf krb5kdc[18949](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:27 dist-test-slave-7lbf krb5kdc[18949](info): set up 2 sockets
Aug 10 06:34:27 dist-test-slave-7lbf krb5kdc[18949](info): commencing operation
krb5kdc: starting...
W20260810 06:34:28.343426 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:28 dist-test-slave-7lbf krb5kdc[18949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:34:28.475880 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35295
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:33863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:35295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:28.598105 18973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:28.598438 18973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:28.598502 18973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:28.602759 18973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:28.602852 18973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:28.602880 18973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:28.602902 18973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:28.602922 18973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:28.608675 18973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:33863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:35295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:28.609975 18973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:28.611155 18973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:28.620643 18979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:28.620645 18983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:28.620787 18973 server_base.cc:1034] running on GCE node
W20260810 06:34:28.620645 18978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:28.621639 18973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:28.622900 18973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:28.624070 18973 hybrid_clock.cc:648] HybridClock initialized: now 1786343668624047 us; error 42 us; skew 500 ppm
Aug 10 06:34:28 dist-test-slave-7lbf krb5kdc[18949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343668, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:28.631386 18973 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:34:28.632516 18973 webserver.cc:460] Webserver started at http://127.21.195.254:40501/ using document root <none> and password file <none>
I20260810 06:34:28.633234 18973 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:28.633337 18973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:28.633651 18973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:28.636029 18973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "2290a5d4ff7c4e78b530f226732655b4"
format_stamp: "Formatted at 2026-08-10 06:34:28 on dist-test-slave-7lbf"
server_key: "cb99b8c9bab95b8588161dd438276bb2"
server_key_iv: "74bf915bfaa7ed21db3a78b32adfd1c1"
server_key_version: "encryptionkey@0"
I20260810 06:34:28.636699 18973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "2290a5d4ff7c4e78b530f226732655b4"
format_stamp: "Formatted at 2026-08-10 06:34:28 on dist-test-slave-7lbf"
server_key: "cb99b8c9bab95b8588161dd438276bb2"
server_key_iv: "74bf915bfaa7ed21db3a78b32adfd1c1"
server_key_version: "encryptionkey@0"
I20260810 06:34:28.641095 18973 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:34:28.644184 18994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:28.645685 18973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:28.645852 18973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "2290a5d4ff7c4e78b530f226732655b4"
format_stamp: "Formatted at 2026-08-10 06:34:28 on dist-test-slave-7lbf"
server_key: "cb99b8c9bab95b8588161dd438276bb2"
server_key_iv: "74bf915bfaa7ed21db3a78b32adfd1c1"
server_key_version: "encryptionkey@0"
I20260810 06:34:28.645987 18973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:28.655756 18973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:28.659153 18973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:28.659363 18973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:28.666963 18973 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:35295
I20260810 06:34:28.666981 19084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:35295 every 8 connection(s)
I20260810 06:34:28.668087 18973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:28.671277 19087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:28.674151 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 18973
I20260810 06:34:28.674306 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:28.674579 22287 external_mini_cluster.cc:1428] Setting key e1b392e3909371afa23c37fe120d4198
I20260810 06:34:28.678539 19087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4: Bootstrap starting.
I20260810 06:34:28.681733 19087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:28.682793 19087 log.cc:824] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:28.685704 19087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4: No bootstrap required, opened a new log
Aug 10 06:34:28 dist-test-slave-7lbf krb5kdc[18949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:28.689595 19087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2290a5d4ff7c4e78b530f226732655b4" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35295 } }
I20260810 06:34:28.689901 19087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:28.689986 19087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2290a5d4ff7c4e78b530f226732655b4, State: Initialized, Role: FOLLOWER
I20260810 06:34:28.690532 19087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2290a5d4ff7c4e78b530f226732655b4" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35295 } }
I20260810 06:34:28.690687 19087 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:28.690755 19087 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:28.690861 19087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:28.691995 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:28.676144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.21.195.254:35295)
0810 06:34:28.676679 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:28.676697 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:28.676739 (+ 42us) server_negotiation.cc:407] Connection header received
0810 06:34:28.677541 (+ 802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:28.677574 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:28.678103 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:28.678532 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:28.680554 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:28.681770 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:28.683011 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:28.683697 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:28.683880 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:28.686737 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:28.686743 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:28.686760 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:28.686791 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:28.688553 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:28.689056 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:28.689062 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:28.689068 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:28.689206 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:28.689499 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:28.689503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:28.689504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:28.690059 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:28.690301 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:28.690627 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 06:34:28.691128 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":173,"threads_started":1}
I20260810 06:34:28.692039 19087 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2290a5d4ff7c4e78b530f226732655b4" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35295 } }
I20260810 06:34:28.692464 19087 leader_election.cc:302] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2290a5d4ff7c4e78b530f226732655b4; no voters:
I20260810 06:34:28.692865 19087 leader_election.cc:288] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:28.692978 19092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:28.693187 19092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [term 1 LEADER]: Becoming Leader. State: Replica: 2290a5d4ff7c4e78b530f226732655b4, State: Running, Role: LEADER
I20260810 06:34:28.693583 19092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2290a5d4ff7c4e78b530f226732655b4" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35295 } }
I20260810 06:34:28.694353 19087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:28.695225 19093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2290a5d4ff7c4e78b530f226732655b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2290a5d4ff7c4e78b530f226732655b4" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35295 } } }
I20260810 06:34:28.695364 19093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:28.695766 19108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:28.695726 19095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2290a5d4ff7c4e78b530f226732655b4. Latest consensus state: current_term: 1 leader_uuid: "2290a5d4ff7c4e78b530f226732655b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2290a5d4ff7c4e78b530f226732655b4" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35295 } } }
I20260810 06:34:28.695847 19095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:28.699213 19108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:28.704908 19108 catalog_manager.cc:1347] Generated new cluster ID: ff80e0c8a42a4d81bc5ccc37212e9a02
I20260810 06:34:28.704998 19108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:28.718999 19108 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:28.720074 19108 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:28.725860 19108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4: Generated new TSK 0
I20260810 06:34:28.726660 19108 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:34:28.760123 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35295
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:33863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:28.888039 19131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:28.888367 19131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:28.888422 19131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:28.892758 19131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:28.892841 19131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:28.892907 19131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:34:28.898934 19131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:33863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:28.900189 19131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:28.901362 19131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:28.911937 19157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:28.911937 19151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:28.912128 19152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:28.912405 19131 server_base.cc:1034] running on GCE node
I20260810 06:34:28.912850 19131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:28.913637 19131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:28.914806 19131 hybrid_clock.cc:648] HybridClock initialized: now 1786343668914783 us; error 37 us; skew 500 ppm
Aug 10 06:34:28 dist-test-slave-7lbf krb5kdc[18949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343668, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:28.917799 19131 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:34:28.918838 19131 webserver.cc:460] Webserver started at http://127.21.195.193:33191/ using document root <none> and password file <none>
I20260810 06:34:28.919440 19131 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:28.919505 19131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:28.919701 19131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:28.922022 19131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "129e863f00f74234be50b7f8704b8c3b"
format_stamp: "Formatted at 2026-08-10 06:34:28 on dist-test-slave-7lbf"
server_key: "1fbf35d66891256ca74e4b2b4ae6c916"
server_key_iv: "cb850eaf63f7f2c811931b63b8c1c1a9"
server_key_version: "encryptionkey@0"
I20260810 06:34:28.922601 19131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "129e863f00f74234be50b7f8704b8c3b"
format_stamp: "Formatted at 2026-08-10 06:34:28 on dist-test-slave-7lbf"
server_key: "1fbf35d66891256ca74e4b2b4ae6c916"
server_key_iv: "cb850eaf63f7f2c811931b63b8c1c1a9"
server_key_version: "encryptionkey@0"
I20260810 06:34:28.926800 19131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:28.929653 19164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:28.931115 19131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:28.931236 19131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "129e863f00f74234be50b7f8704b8c3b"
format_stamp: "Formatted at 2026-08-10 06:34:28 on dist-test-slave-7lbf"
server_key: "1fbf35d66891256ca74e4b2b4ae6c916"
server_key_iv: "cb850eaf63f7f2c811931b63b8c1c1a9"
server_key_version: "encryptionkey@0"
I20260810 06:34:28.931368 19131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:28.944188 19131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:28.947846 19131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:28.948055 19131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:28.948789 19131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:28.949816 19131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:28.949870 19131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:28.949920 19131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:28.949950 19131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:28.959719 19131 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:46351
I20260810 06:34:28.959774 19351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:46351 every 8 connection(s)
I20260810 06:34:28.960800 19131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:34:28.969142 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 19131
I20260810 06:34:28.969285 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:34:28.969684 22287 external_mini_cluster.cc:1428] Setting key 35951ffc42bb0f468d64610160cce33c
Aug 10 06:34:28 dist-test-slave-7lbf krb5kdc[18949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343668, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:28.976234 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:28.962901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:50727 (local address 127.21.195.254:35295)
0810 06:34:28.963039 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:28.963043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:28.964063 (+ 1020us) server_negotiation.cc:407] Connection header received
0810 06:34:28.965543 (+ 1480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:28.965547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:28.965615 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:28.965697 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:28.967069 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:28.967634 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:28.968922 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:28.969176 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:28.969299 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:28.972438 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:28.972441 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:28.972443 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:28.972472 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:28.973917 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:28.974477 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:28.974481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:28.974482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:28.974569 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:28.974992 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:28.974995 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:28.974997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:28.975214 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:28.975307 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:28.975971 (+ 664us) server_negotiation.cc:299] Negotiation successful
0810 06:34:28.976098 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:34:28.977641 19355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:28.963302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35295 (local address 127.21.195.193:50727)
0810 06:34:28.963870 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:28.963923 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:28.965267 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:28.965921 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:28.965929 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:28.966323 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:28.966885 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:28.966902 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:28.967783 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:28.967786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:28.968760 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:28.968774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:28.969409 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:28.969415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:28.969696 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:28.970384 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:28.970405 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:28.972236 (+ 1831us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:28.974042 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:28.974050 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:28.974071 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:28.974375 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:28.974658 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:28.974661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:28.974663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:28.974874 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:28.975335 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:28.975342 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:28.975710 (+ 368us) client_negotiation.cc:769] Sending connection context
0810 06:34:28.975940 (+ 230us) client_negotiation.cc:240] Negotiation successful
0810 06:34:28.976357 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":132,"threads_started":1}
I20260810 06:34:28.979174 19353 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35295
I20260810 06:34:28.979499 19353 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:28.980180 19353 heartbeater.cc:511] Master 127.21.195.254:35295 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
I20260810 06:34:28.982034 19021 ts_manager.cc:194] Registered new tserver with Master: 129e863f00f74234be50b7f8704b8c3b (127.21.195.193:46351)
I20260810 06:34:28.983299 19021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:50727
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:34:28.998642 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35295
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:33863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:29.121547 19361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:29.121909 19361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:29.121974 19361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:29.126210 19361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:29.126289 19361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:29.126371 19361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:34:29.132189 19361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:33863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:29.133416 19361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:29.134689 19361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:29.145386 19376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:29.145396 19375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:29.145454 19378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:29.145915 19361 server_base.cc:1034] running on GCE node
I20260810 06:34:29.146350 19361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:29.147105 19361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:29.148305 19361 hybrid_clock.cc:648] HybridClock initialized: now 1786343669148265 us; error 51 us; skew 500 ppm
Aug 10 06:34:29 dist-test-slave-7lbf krb5kdc[18949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343669, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:29.151665 19361 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:34:29.152753 19361 webserver.cc:460] Webserver started at http://127.21.195.194:35117/ using document root <none> and password file <none>
I20260810 06:34:29.153406 19361 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:29.153496 19361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:29.153771 19361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:29.156127 19361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "4f226a3944dd43a087890922563e53fe"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "19a973081ab737744698a70d2fc714e4"
server_key_iv: "f1d0835cb7bf1a67fd145f42463c4f2c"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.156764 19361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "4f226a3944dd43a087890922563e53fe"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "19a973081ab737744698a70d2fc714e4"
server_key_iv: "f1d0835cb7bf1a67fd145f42463c4f2c"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.161211 19361 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260810 06:34:29.164023 19388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:29.165462 19361 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 06:34:29.165657 19361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "4f226a3944dd43a087890922563e53fe"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "19a973081ab737744698a70d2fc714e4"
server_key_iv: "f1d0835cb7bf1a67fd145f42463c4f2c"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.165783 19361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:29.182993 19361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:29.186269 19361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:29.186496 19361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:29.187196 19361 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:29.188159 19361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:29.188223 19361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:29.188285 19361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:29.188309 19361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:29.198807 19361 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:46581
I20260810 06:34:29.198834 19583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:46581 every 8 connection(s)
I20260810 06:34:29.199864 19361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:34:29.207100 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 19361
I20260810 06:34:29.207226 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:34:29.207508 22287 external_mini_cluster.cc:1428] Setting key 33835922309d1d5e6cb28d2705ed3ece
Aug 10 06:34:29 dist-test-slave-7lbf krb5kdc[18949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343669, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:29.215171 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.201796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:47041 (local address 127.21.195.254:35295)
0810 06:34:29.201927 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.201931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.202910 (+ 979us) server_negotiation.cc:407] Connection header received
0810 06:34:29.204382 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.204386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.204465 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.204543 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:29.206033 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.206584 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.207888 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.208121 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.208218 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.210938 (+ 2720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:29.210942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:29.210944 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:29.210974 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:29.212478 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:29.213140 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:29.213144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:29.213145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:29.213247 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:29.213740 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:29.213743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:29.213744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:29.213981 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:29.214077 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.214893 (+ 816us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.215032 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:34:29.216542 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.202231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35295 (local address 127.21.195.194:47041)
0810 06:34:29.202735 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:29.202785 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:29.204134 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:29.204779 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:29.204787 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:29.205220 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:29.205855 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.205873 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.206725 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.206728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.207750 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.207762 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.208281 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.208285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.208470 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.209087 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:29.209106 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:29.210735 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:29.212610 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:29.212618 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:29.212639 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:29.213012 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:29.213349 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:29.213352 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:29.213354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:29.213614 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:29.214097 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:29.214106 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:29.214533 (+ 427us) client_negotiation.cc:769] Sending connection context
0810 06:34:29.214781 (+ 248us) client_negotiation.cc:240] Negotiation successful
0810 06:34:29.215225 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":127,"threads_started":1}
I20260810 06:34:29.218026 19585 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35295
I20260810 06:34:29.218331 19585 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:29.218945 19585 heartbeater.cc:511] Master 127.21.195.254:35295 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:34:29.220222 19021 ts_manager.cc:194] Registered new tserver with Master: 4f226a3944dd43a087890922563e53fe (127.21.195.194:46581)
I20260810 06:34:29.220958 19021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:47041
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:34:29.238461 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35295
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:33863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:29.363404 19592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:29.363736 19592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:29.363782 19592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:29.368114 19592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:29.368204 19592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:29.368269 19592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:34:29.374222 19592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:33863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:29.375456 19592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:29.376655 19592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:29.387706 19598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:29.387732 19605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:29.387717 19599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:29.387768 19592 server_base.cc:1034] running on GCE node
I20260810 06:34:29.388401 19592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:29.389196 19592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:29.390383 19592 hybrid_clock.cc:648] HybridClock initialized: now 1786343669390361 us; error 52 us; skew 500 ppm
Aug 10 06:34:29 dist-test-slave-7lbf krb5kdc[18949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343669, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:29.393467 19592 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:34:29.394598 19592 webserver.cc:460] Webserver started at http://127.21.195.195:35915/ using document root <none> and password file <none>
I20260810 06:34:29.395293 19592 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:29.395364 19592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:29.395632 19592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:29.398120 19592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "9b4a15add8c74691a3bc2c8c72ddf71e"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "bda06a5d82c29951510978f09648b413"
server_key_iv: "d8e5299667e0313de766155de48eb15b"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.398769 19592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "9b4a15add8c74691a3bc2c8c72ddf71e"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "bda06a5d82c29951510978f09648b413"
server_key_iv: "d8e5299667e0313de766155de48eb15b"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.403221 19592 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:29.405968 19614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:29.407401 19592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:29.407536 19592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "9b4a15add8c74691a3bc2c8c72ddf71e"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "bda06a5d82c29951510978f09648b413"
server_key_iv: "d8e5299667e0313de766155de48eb15b"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.407660 19592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:29.441625 19592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:29.445180 19592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:29.445392 19592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:29.446123 19592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:29.447093 19592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:29.447146 19592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:29.447192 19592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:29.447220 19592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:29.456411 19592 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:45343
I20260810 06:34:29.456459 19810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:45343 every 8 connection(s)
I20260810 06:34:29.457475 19592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:34:29.467374 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 19592
I20260810 06:34:29.467517 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
Aug 10 06:34:29 dist-test-slave-7lbf krb5kdc[18949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343669, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:29.467839 22287 external_mini_cluster.cc:1428] Setting key 978a4077a8e8b37b7b2352dabc629e39
I20260810 06:34:29.472275 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.459546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:60681 (local address 127.21.195.254:35295)
0810 06:34:29.459736 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.459741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.460747 (+ 1006us) server_negotiation.cc:407] Connection header received
0810 06:34:29.462216 (+ 1469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.462219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.462274 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.462370 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:29.463634 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.464176 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.465365 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.465605 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.465686 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.468424 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:29.468429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:29.468431 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:29.468465 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:29.470063 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:29.470702 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:29.470711 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:29.470713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:29.470826 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:29.471199 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:29.471202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:29.471204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:29.471425 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:29.471518 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.472027 (+ 509us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.472143 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260810 06:34:29.473263 19813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.460041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35295 (local address 127.21.195.195:60681)
0810 06:34:29.460554 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:29.460607 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:29.461987 (+ 1380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:29.462537 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:29.462545 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:29.462930 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:29.463492 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.463508 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.464289 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.464291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.465249 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.465259 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.465751 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.465754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.465918 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.466523 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:29.466541 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:29.468196 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:29.470175 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:29.470183 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:29.470203 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:29.470563 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:29.470917 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:29.470920 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:29.470921 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:29.471083 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:29.471519 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:29.471525 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:29.471804 (+ 279us) client_negotiation.cc:769] Sending connection context
0810 06:34:29.471993 (+ 189us) client_negotiation.cc:240] Negotiation successful
0810 06:34:29.472297 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":121,"threads_started":1}
I20260810 06:34:29.474551 19811 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35295
I20260810 06:34:29.474807 19811 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:29.475338 19811 heartbeater.cc:511] Master 127.21.195.254:35295 requested a full tablet report, sending...
I20260810 06:34:29.476478 19021 ts_manager.cc:194] Registered new tserver with Master: 9b4a15add8c74691a3bc2c8c72ddf71e (127.21.195.195:45343)
I20260810 06:34:29.477097 19021 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:60681
I20260810 06:34:29.482334 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:34:29.492416 19090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.484370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53388 (local address 127.21.195.254:35295)
0810 06:34:29.484496 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.484501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.484677 (+ 176us) server_negotiation.cc:407] Connection header received
0810 06:34:29.484801 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.484804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.484855 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.484932 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:29.485717 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.486271 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.487142 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.487370 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.487460 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.489140 (+ 1680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:29.489144 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:29.489147 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:29.489179 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:29.490448 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:29.491003 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:29.491007 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:29.491009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:29.491102 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:29.491428 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:29.491440 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:29.491442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:29.491680 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:29.491834 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.492143 (+ 309us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.492248 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:34:29.495669 19021 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:34:29.499032 19021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:34:29.514786 19833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.508892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52050 (local address 127.21.195.195:45343)
0810 06:34:29.509704 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.509715 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.509736 (+ 21us) server_negotiation.cc:407] Connection header received
0810 06:34:29.509807 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.509812 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.509999 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.510153 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:29.510578 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.511764 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.513079 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.514004 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.514143 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.514310 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.514496 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.514619 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":203,"threads_started":1}
I20260810 06:34:29.514788 19828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.508065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46581 (local address 127.0.0.1:50560)
0810 06:34:29.508994 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:29.509057 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:29.509211 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:29.510004 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:29.510010 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:29.510032 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:29.510199 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.510207 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.511895 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.511898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.513136 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.513148 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.514244 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.514247 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.514335 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.514360 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:34:29.514414 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 06:34:29.514619 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":811,"mutex_wait_us":46,"spinlock_wait_cycles":4992,"thread_start_us":114,"threads_started":1}
I20260810 06:34:29.515084 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.508357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50560 (local address 127.21.195.194:46581)
0810 06:34:29.509410 (+ 1053us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.509425 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.509450 (+ 25us) server_negotiation.cc:407] Connection header received
0810 06:34:29.509559 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.509566 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.509808 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.510356 (+ 548us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:29.510541 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.511761 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.513277 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.514110 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.514653 (+ 543us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.514791 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.514845 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.514957 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":939,"thread_start_us":142,"threads_started":1}
I20260810 06:34:29.515118 19827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.508352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:46351 (local address 127.0.0.1:48896)
0810 06:34:29.509679 (+ 1327us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:29.509694 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:29.509857 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:29.510539 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:29.510542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:29.510557 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:29.510632 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.510636 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.511661 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.511664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.513570 (+ 1906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.513582 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.514750 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.514754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.514835 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.514855 (+ 20us) client_negotiation.cc:769] Sending connection context
0810 06:34:29.514920 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 06:34:29.514995 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1263,"mutex_wait_us":50,"thread_start_us":123,"threads_started":1}
I20260810 06:34:29.515319 19824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.508042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45343 (local address 127.0.0.1:52050)
0810 06:34:29.508994 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:29.509057 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:29.509211 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:29.510306 (+ 1095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:29.510309 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:29.510326 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:29.510422 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.510427 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.511956 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.511959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.512941 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.512953 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.514145 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.514149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.514265 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.514312 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 06:34:29.514444 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 06:34:29.515202 (+ 758us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"mutex_wait_us":5,"spinlock_wait_cycles":17792,"thread_start_us":109,"threads_started":1}
I20260810 06:34:29.515563 19832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.508944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48896 (local address 127.21.195.193:46351)
0810 06:34:29.509483 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.509488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.509781 (+ 293us) server_negotiation.cc:407] Connection header received
0810 06:34:29.510005 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.510011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.510215 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.510336 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:29.510743 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.511552 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.513710 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.514428 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.514554 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.514688 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.515289 (+ 601us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.515405 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":92,"threads_started":1}
I20260810 06:34:29.518955 19236 tablet_service.cc:1467] Processing CreateTablet for tablet cfe215d801014c63bd46c44ad75b5fbc (DEFAULT_TABLE table=test-table [id=8e33d9783e404733840a93aefff44cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:29.518975 19702 tablet_service.cc:1467] Processing CreateTablet for tablet cfe215d801014c63bd46c44ad75b5fbc (DEFAULT_TABLE table=test-table [id=8e33d9783e404733840a93aefff44cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:29.518975 19475 tablet_service.cc:1467] Processing CreateTablet for tablet cfe215d801014c63bd46c44ad75b5fbc (DEFAULT_TABLE table=test-table [id=8e33d9783e404733840a93aefff44cc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:29.520131 19236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe215d801014c63bd46c44ad75b5fbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:29.520134 19702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe215d801014c63bd46c44ad75b5fbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:29.520134 19475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe215d801014c63bd46c44ad75b5fbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:29.527607 19837 tablet_bootstrap.cc:492] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b: Bootstrap starting.
I20260810 06:34:29.529070 19839 tablet_bootstrap.cc:492] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: Bootstrap starting.
I20260810 06:34:29.529909 19838 tablet_bootstrap.cc:492] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: Bootstrap starting.
I20260810 06:34:29.530176 19837 tablet_bootstrap.cc:654] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:29.530992 19837 log.cc:824] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:29.531533 19839 tablet_bootstrap.cc:654] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:29.532311 19838 tablet_bootstrap.cc:654] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:29.532967 19839 log.cc:824] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:29.533300 19837 tablet_bootstrap.cc:492] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b: No bootstrap required, opened a new log
I20260810 06:34:29.533607 19837 ts_tablet_manager.cc:1397] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:34:29.533761 19838 log.cc:824] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:29.535257 19839 tablet_bootstrap.cc:492] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: No bootstrap required, opened a new log
I20260810 06:34:29.535475 19839 ts_tablet_manager.cc:1397] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 06:34:29.535957 19838 tablet_bootstrap.cc:492] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: No bootstrap required, opened a new log
I20260810 06:34:29.536149 19838 ts_tablet_manager.cc:1397] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:34:29.537647 19837 raft_consensus.cc:348] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.537922 19837 raft_consensus.cc:374] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:29.538000 19837 raft_consensus.cc:729] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129e863f00f74234be50b7f8704b8c3b, State: Initialized, Role: FOLLOWER
I20260810 06:34:29.538522 19837 consensus_queue.cc:260] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.539819 19837 ts_tablet_manager.cc:1428] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:34:29.539886 19839 raft_consensus.cc:348] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.539974 19838 raft_consensus.cc:348] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.540194 19838 raft_consensus.cc:374] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:29.540254 19353 heartbeater.cc:503] Master 127.21.195.254:35295 was elected leader, sending a full tablet report...
I20260810 06:34:29.540267 19839 raft_consensus.cc:374] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:29.540284 19838 raft_consensus.cc:729] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b4a15add8c74691a3bc2c8c72ddf71e, State: Initialized, Role: FOLLOWER
I20260810 06:34:29.540323 19839 raft_consensus.cc:729] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f226a3944dd43a087890922563e53fe, State: Initialized, Role: FOLLOWER
I20260810 06:34:29.540829 19838 consensus_queue.cc:260] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.540829 19839 consensus_queue.cc:260] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.541736 19585 heartbeater.cc:503] Master 127.21.195.254:35295 was elected leader, sending a full tablet report...
I20260810 06:34:29.541857 19811 heartbeater.cc:503] Master 127.21.195.254:35295 was elected leader, sending a full tablet report...
I20260810 06:34:29.541944 19838 ts_tablet_manager.cc:1428] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 06:34:29.542155 19839 ts_tablet_manager.cc:1428] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 06:34:29.562129 19845 raft_consensus.cc:482] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:29.562376 19845 raft_consensus.cc:504] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.563625 19845 leader_election.cc:288] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9b4a15add8c74691a3bc2c8c72ddf71e (127.21.195.195:45343), 129e863f00f74234be50b7f8704b8c3b (127.21.195.193:46351)
I20260810 06:34:29.568813 19832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.564042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:54893 (local address 127.21.195.193:46351)
0810 06:34:29.564172 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.564176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.564357 (+ 181us) server_negotiation.cc:407] Connection header received
0810 06:34:29.564424 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.564427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.564486 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.564561 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:29.564820 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.565671 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.567441 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.568116 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.568248 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.568311 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.568585 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.568682 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 06:34:29.568813 19833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.564058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:48977 (local address 127.21.195.195:45343)
0810 06:34:29.564177 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.564181 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.564426 (+ 245us) server_negotiation.cc:407] Connection header received
0810 06:34:29.564539 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.564542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.564596 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.564674 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:29.564945 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.565690 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.567441 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.568107 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.568248 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.568307 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.568585 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.568676 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 06:34:29.568818 19588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.563923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:46351 (local address 127.21.195.194:54893)
0810 06:34:29.564149 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:29.564164 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:29.564269 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:29.564566 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:29.564568 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:29.564578 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:29.564704 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.564711 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.565791 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.565795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.567266 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.567281 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.568244 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.568248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.568439 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.568457 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 06:34:29.568527 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 06:34:29.568638 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":118}
I20260810 06:34:29.568826 19850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.563923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45343 (local address 127.21.195.194:48977)
0810 06:34:29.564326 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:29.564339 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:29.564451 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:29.564708 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:29.564711 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:29.564728 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:29.564851 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.564856 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.565791 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.565795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.567266 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:29.567281 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.568244 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.568248 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:29.568405 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.568445 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 06:34:29.568527 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 06:34:29.568638 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":173,"thread_start_us":156,"threads_started":1}
I20260810 06:34:29.569669 19733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe215d801014c63bd46c44ad75b5fbc" candidate_uuid: "4f226a3944dd43a087890922563e53fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" is_pre_election: true
I20260810 06:34:29.569665 19278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe215d801014c63bd46c44ad75b5fbc" candidate_uuid: "4f226a3944dd43a087890922563e53fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129e863f00f74234be50b7f8704b8c3b" is_pre_election: true
I20260810 06:34:29.570057 19278 raft_consensus.cc:2454] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f226a3944dd43a087890922563e53fe in term 0.
I20260810 06:34:29.570058 19733 raft_consensus.cc:2454] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f226a3944dd43a087890922563e53fe in term 0.
I20260810 06:34:29.570639 19393 leader_election.cc:302] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f226a3944dd43a087890922563e53fe, 9b4a15add8c74691a3bc2c8c72ddf71e; no voters:
I20260810 06:34:29.570986 19845 raft_consensus.cc:2781] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:34:29.571077 19845 raft_consensus.cc:482] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:34:29.571125 19845 raft_consensus.cc:3037] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:29.572283 19845 raft_consensus.cc:504] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.572701 19845 leader_election.cc:288] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [CANDIDATE]: Term 1 election: Requested vote from peers 9b4a15add8c74691a3bc2c8c72ddf71e (127.21.195.195:45343), 129e863f00f74234be50b7f8704b8c3b (127.21.195.193:46351)
I20260810 06:34:29.573092 19733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe215d801014c63bd46c44ad75b5fbc" candidate_uuid: "4f226a3944dd43a087890922563e53fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e"
I20260810 06:34:29.573127 19278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe215d801014c63bd46c44ad75b5fbc" candidate_uuid: "4f226a3944dd43a087890922563e53fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129e863f00f74234be50b7f8704b8c3b"
I20260810 06:34:29.573236 19733 raft_consensus.cc:3037] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:29.573257 19278 raft_consensus.cc:3037] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:29.574391 19278 raft_consensus.cc:2454] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f226a3944dd43a087890922563e53fe in term 1.
I20260810 06:34:29.574398 19733 raft_consensus.cc:2454] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f226a3944dd43a087890922563e53fe in term 1.
I20260810 06:34:29.574733 19396 leader_election.cc:302] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129e863f00f74234be50b7f8704b8c3b, 4f226a3944dd43a087890922563e53fe; no voters:
I20260810 06:34:29.574929 19845 raft_consensus.cc:2781] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:29.575207 19845 raft_consensus.cc:686] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 1 LEADER]: Becoming Leader. State: Replica: 4f226a3944dd43a087890922563e53fe, State: Running, Role: LEADER
I20260810 06:34:29.575574 19845 consensus_queue.cc:237] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } }
I20260810 06:34:29.579372 19020 catalog_manager.cc:5495] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f226a3944dd43a087890922563e53fe (127.21.195.194). New cstate: current_term: 1 leader_uuid: "4f226a3944dd43a087890922563e53fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f226a3944dd43a087890922563e53fe" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 } health_report { overall_health: UNKNOWN } } }
I20260810 06:34:29.598270 19829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.594300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.21.195.194:46581)
0810 06:34:29.594462 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.594467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.594483 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:34:29.594627 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.594629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.594705 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.594831 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:34:29.595136 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.595706 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.596647 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.596890 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.596983 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.597244 (+ 261us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:34:29.597789 (+ 545us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:34:29.597927 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.598035 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.598082 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:34:29.605114 19278 raft_consensus.cc:1261] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [term 1 FOLLOWER]: Refusing update from remote peer 4f226a3944dd43a087890922563e53fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:29.605114 19733 raft_consensus.cc:1261] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 1 FOLLOWER]: Refusing update from remote peer 4f226a3944dd43a087890922563e53fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:29.605924 19851 consensus_queue.cc:1035] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "129e863f00f74234be50b7f8704b8c3b" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 46351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:29.606118 19845 consensus_queue.cc:1035] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b4a15add8c74691a3bc2c8c72ddf71e" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:29.614590 19861 mvcc.cc:205] Tried to move back new op lower bound from 7316863670693715968 to 7316863670584401920. Current Snapshot: MvccSnapshot[applied={T|T < 7316863670693715968}]
I20260810 06:34:29.624003 19021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:29.624243 19021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:29.627202 19021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2290a5d4ff7c4e78b530f226732655b4: Sending DeleteTablet for 3 replicas of tablet cfe215d801014c63bd46c44ad75b5fbc
I20260810 06:34:29.628176 19702 tablet_service.cc:1514] Processing DeleteTablet for tablet cfe215d801014c63bd46c44ad75b5fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:29 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:52050
I20260810 06:34:29.628422 19475 tablet_service.cc:1514] Processing DeleteTablet for tablet cfe215d801014c63bd46c44ad75b5fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:29 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50560
I20260810 06:34:29.628427 19236 tablet_service.cc:1514] Processing DeleteTablet for tablet cfe215d801014c63bd46c44ad75b5fbc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:29 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:48896
I20260810 06:34:29.628968 19879 tablet_replica.cc:330] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: stopping tablet replica
I20260810 06:34:29.628966 19880 tablet_replica.cc:330] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b: stopping tablet replica
I20260810 06:34:29.629139 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 19131
I20260810 06:34:29.629351 19879 raft_consensus.cc:2229] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:34:29.629351 19880 raft_consensus.cc:2229] T cfe215d801014c63bd46c44ad75b5fbc P 129e863f00f74234be50b7f8704b8c3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:29.630357 19879 raft_consensus.cc:2258] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:29.634682 19879 ts_tablet_manager.cc:1905] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:29.637420 19879 ts_tablet_manager.cc:1918] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:29.637542 19879 log.cc:1196] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/cfe215d801014c63bd46c44ad75b5fbc
I20260810 06:34:29.637885 19879 ts_tablet_manager.cc:1939] T cfe215d801014c63bd46c44ad75b5fbc P 4f226a3944dd43a087890922563e53fe: Deleting consensus metadata
I20260810 06:34:29.639653 18995 catalog_manager.cc:4841] TS 4f226a3944dd43a087890922563e53fe (127.21.195.194:46581): tablet cfe215d801014c63bd46c44ad75b5fbc (table test-table [id=8e33d9783e404733840a93aefff44cc3]) successfully deleted
I20260810 06:34:29.642643 19878 tablet_replica.cc:330] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: stopping tablet replica
I20260810 06:34:29.643105 19878 raft_consensus.cc:2229] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:29.643512 19878 raft_consensus.cc:2258] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:29.645155 19878 ts_tablet_manager.cc:1905] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:29.647811 19878 ts_tablet_manager.cc:1918] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:29.647929 19878 log.cc:1196] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/cfe215d801014c63bd46c44ad75b5fbc
I20260810 06:34:29.648283 19878 ts_tablet_manager.cc:1939] T cfe215d801014c63bd46c44ad75b5fbc P 9b4a15add8c74691a3bc2c8c72ddf71e: Deleting consensus metadata
I20260810 06:34:29.649765 18998 catalog_manager.cc:4841] TS 9b4a15add8c74691a3bc2c8c72ddf71e (127.21.195.195:45343): tablet cfe215d801014c63bd46c44ad75b5fbc (table test-table [id=8e33d9783e404733840a93aefff44cc3]) successfully deleted
W20260810 06:34:29.650995 19001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:46351 (error 108)
I20260810 06:34:29.651046 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 19361
I20260810 06:34:29.666823 19824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.666355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:46351 (local address 127.0.0.1:48910)
0810 06:34:29.666601 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:29.666706 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:46351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
W20260810 06:34:29.667263 19001 catalog_manager.cc:4584] TS 129e863f00f74234be50b7f8704b8c3b (127.21.195.193:46351): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cfe215d801014c63bd46c44ad75b5fbc: Network error: Client connection negotiation failed: client connection to 127.21.195.193:46351: connect: Connection refused (error 111)
I20260810 06:34:29.673308 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 19592
I20260810 06:34:29.688382 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 18973
2026-08-10T06:34:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2529 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T06:34:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:29Z Disabled control of system clock
I20260810 06:34:29.728713 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:37373
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:37373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:34:29.853271 19886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:29.853654 19886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:29.853694 19886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:29.858091 19886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:29.858177 19886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:29.858191 19886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:29.858208 19886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:29.858222 19886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:29.863473 19886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:37373
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:37373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:29.864830 19886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:29.866466 19886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:29.876132 19896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:29.876176 19886 server_base.cc:1034] running on GCE node
W20260810 06:34:29.876132 19894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:29.876116 19898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:29.877045 19886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:29.878360 19886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:29.879542 19886 hybrid_clock.cc:648] HybridClock initialized: now 1786343669879522 us; error 35 us; skew 500 ppm
I20260810 06:34:29.881649 19886 webserver.cc:460] Webserver started at http://127.21.195.254:41177/ using document root <none> and password file <none>
I20260810 06:34:29.882319 19886 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:29.882396 19886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:29.882622 19886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:29.884939 19886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "4bcfe3de828143d2ba5c6a6db03509c1"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "14428c27d7502a31a8de2c7068fba098"
server_key_iv: "539001b57fd74c4bf5221f8ca878905f"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.885584 19886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "4bcfe3de828143d2ba5c6a6db03509c1"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "14428c27d7502a31a8de2c7068fba098"
server_key_iv: "539001b57fd74c4bf5221f8ca878905f"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.889940 19886 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:29.893472 19910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:29.895399 19886 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:34:29.895579 19886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "4bcfe3de828143d2ba5c6a6db03509c1"
format_stamp: "Formatted at 2026-08-10 06:34:29 on dist-test-slave-7lbf"
server_key: "14428c27d7502a31a8de2c7068fba098"
server_key_iv: "539001b57fd74c4bf5221f8ca878905f"
server_key_version: "encryptionkey@0"
I20260810 06:34:29.895732 19886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:29.920792 19886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:29.921717 19886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:29.921922 19886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:29.929204 19886 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:37373
I20260810 06:34:29.929217 19996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:37373 every 8 connection(s)
I20260810 06:34:29.930344 19886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:29.934055 20001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:29.936285 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 19886
I20260810 06:34:29.936426 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:29.936707 22287 external_mini_cluster.cc:1428] Setting key 3e68a60dfd7a001b82f4065a42d18ab2
I20260810 06:34:29.940923 20001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1: Bootstrap starting.
I20260810 06:34:29.943447 20001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:29.944235 20001 log.cc:824] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:29.946517 20001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1: No bootstrap required, opened a new log
I20260810 06:34:29.946789 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:29.938318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.21.195.254:37373)
0810 06:34:29.939083 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:29.939101 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:29.939142 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:34:29.939909 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:29.939949 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:29.940401 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:29.940748 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:29.941236 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.942296 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.943231 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:29.943789 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:29.943964 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:29.944860 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:29.944866 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:29.944881 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:29.945312 (+ 431us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:29.945374 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:29.945395 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:29.945489 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:29.945686 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 06:34:29.945990 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":152,"threads_started":1}
I20260810 06:34:29.950778 20001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcfe3de828143d2ba5c6a6db03509c1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37373 } }
I20260810 06:34:29.951056 20001 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:29.951107 20001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bcfe3de828143d2ba5c6a6db03509c1, State: Initialized, Role: FOLLOWER
I20260810 06:34:29.951587 20001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcfe3de828143d2ba5c6a6db03509c1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37373 } }
I20260810 06:34:29.951722 20001 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:29.951790 20001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:29.951893 20001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:29.952914 20001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcfe3de828143d2ba5c6a6db03509c1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37373 } }
I20260810 06:34:29.953274 20001 leader_election.cc:302] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bcfe3de828143d2ba5c6a6db03509c1; no voters:
I20260810 06:34:29.953656 20001 leader_election.cc:288] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:29.953770 20009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:29.954047 20009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [term 1 LEADER]: Becoming Leader. State: Replica: 4bcfe3de828143d2ba5c6a6db03509c1, State: Running, Role: LEADER
I20260810 06:34:29.954371 20009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcfe3de828143d2ba5c6a6db03509c1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37373 } }
I20260810 06:34:29.955093 20001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:29.956065 20010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4bcfe3de828143d2ba5c6a6db03509c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcfe3de828143d2ba5c6a6db03509c1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37373 } } }
I20260810 06:34:29.956214 20010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:29.956121 20012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4bcfe3de828143d2ba5c6a6db03509c1. Latest consensus state: current_term: 1 leader_uuid: "4bcfe3de828143d2ba5c6a6db03509c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bcfe3de828143d2ba5c6a6db03509c1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37373 } } }
I20260810 06:34:29.956429 20012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:29.956597 20024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:29.960254 20024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:29.967136 20024 catalog_manager.cc:1347] Generated new cluster ID: e6ad3461bc3e46b28af41777fc43c3c6
I20260810 06:34:29.967216 20024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:29.979839 20024 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:29.980865 20024 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:29.989866 20024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1: Generated new TSK 0
I20260810 06:34:29.990710 20024 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:29.998998 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37373
--builtin_ntp_servers=127.21.195.212:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:34:30.143224 20048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:30.143553 20048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:30.143594 20048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:30.147765 20048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:30.147840 20048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:30.147904 20048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:34:30.153000 20048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20048
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:30.154258 20048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:30.155833 20048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:34:30.167012 20048 server_base.cc:1034] running on GCE node
W20260810 06:34:30.166960 20055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:30.166956 20061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:30.166956 20056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:30.167732 20048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:30.168501 20048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:30.169677 20048 hybrid_clock.cc:648] HybridClock initialized: now 1786343670169648 us; error 40 us; skew 500 ppm
I20260810 06:34:30.171931 20048 webserver.cc:460] Webserver started at http://127.21.195.193:36993/ using document root <none> and password file <none>
I20260810 06:34:30.172595 20048 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:30.172672 20048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:30.172909 20048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:30.175230 20048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "b90503003dcd4ba7919646f85a1edf29"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "f7ec27617898a5c2a3427c2696e3808f"
server_key_iv: "ffa6367d6a2120237813e9696d6fa41d"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.175872 20048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "b90503003dcd4ba7919646f85a1edf29"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "f7ec27617898a5c2a3427c2696e3808f"
server_key_iv: "ffa6367d6a2120237813e9696d6fa41d"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.180140 20048 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:34:30.183213 20070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.184610 20048 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:34:30.184769 20048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "b90503003dcd4ba7919646f85a1edf29"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "f7ec27617898a5c2a3427c2696e3808f"
server_key_iv: "ffa6367d6a2120237813e9696d6fa41d"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.184898 20048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:30.198086 20048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:30.198943 20048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:30.199165 20048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:30.199856 20048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:30.201053 20048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:30.201128 20048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.201190 20048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:30.201215 20048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.210180 20048 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:36495
I20260810 06:34:30.210207 20248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:36495 every 8 connection(s)
I20260810 06:34:30.211230 20048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:34:30.218413 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 20048
I20260810 06:34:30.218537 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:34:30.218901 22287 external_mini_cluster.cc:1428] Setting key ddc60d4b52b28fe88968560cbcc9aaa5
I20260810 06:34:30.221323 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37373
--builtin_ntp_servers=127.21.195.212:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:34:30.222043 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.213274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:33301 (local address 127.21.195.254:37373)
0810 06:34:30.213431 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.213434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.214700 (+ 1266us) server_negotiation.cc:407] Connection header received
0810 06:34:30.216247 (+ 1547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.216251 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.216317 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.216396 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:30.217504 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.218103 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.219540 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.219861 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.219974 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.221416 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:30.221421 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:30.221424 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:30.221443 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:30.221473 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:30.221487 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:30.221600 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.221851 (+ 251us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.221919 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:34:30.223448 20253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.213805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37373 (local address 127.21.195.193:33301)
0810 06:34:30.214527 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:30.214574 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:30.215975 (+ 1401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:30.216634 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:30.216644 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:30.216749 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:30.217328 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.217344 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.218247 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.218251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.219368 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.219385 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.220060 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.220065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.220285 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.221081 (+ 796us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:30.221082 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:30.221136 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:30.221221 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:30.221652 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:30.221667 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:30.221674 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:34:30.221834 (+ 160us) client_negotiation.cc:240] Negotiation successful
0810 06:34:30.222222 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":115,"threads_started":1}
I20260810 06:34:30.225085 20250 heartbeater.cc:347] Connected to a master server at 127.21.195.254:37373
I20260810 06:34:30.225387 20250 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:30.226073 20250 heartbeater.cc:511] Master 127.21.195.254:37373 requested a full tablet report, sending...
I20260810 06:34:30.227931 19938 ts_manager.cc:194] Registered new tserver with Master: b90503003dcd4ba7919646f85a1edf29 (127.21.195.193:36495)
I20260810 06:34:30.229225 19938 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.193:33301
W20260810 06:34:30.346259 20255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:30.346588 20255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:30.346629 20255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:30.350975 20255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:30.351099 20255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:30.351161 20255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:34:30.356448 20255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:30.357798 20255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:30.359421 20255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:30.370345 20260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:30.370391 20255 server_base.cc:1034] running on GCE node
W20260810 06:34:30.370332 20264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:30.370328 20261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:30.371160 20255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:30.371914 20255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:30.373082 20255 hybrid_clock.cc:648] HybridClock initialized: now 1786343670373055 us; error 43 us; skew 500 ppm
I20260810 06:34:30.375221 20255 webserver.cc:460] Webserver started at http://127.21.195.194:36025/ using document root <none> and password file <none>
I20260810 06:34:30.375869 20255 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:30.375946 20255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:30.376154 20255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:30.378561 20255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "2b72d0adf2b147e9a92f93def99aed0f"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "b730d110bdd11a1f54c36a5f4f041e4e"
server_key_iv: "f4d248c8094fbc82ce3ea072e99e0e77"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.379210 20255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "2b72d0adf2b147e9a92f93def99aed0f"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "b730d110bdd11a1f54c36a5f4f041e4e"
server_key_iv: "f4d248c8094fbc82ce3ea072e99e0e77"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.383462 20255 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:34:30.386384 20272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.387817 20255 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:34:30.387959 20255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "2b72d0adf2b147e9a92f93def99aed0f"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "b730d110bdd11a1f54c36a5f4f041e4e"
server_key_iv: "f4d248c8094fbc82ce3ea072e99e0e77"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.388159 20255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:30.415045 20255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:30.415907 20255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:30.416121 20255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:30.416826 20255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:30.417971 20255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:30.418028 20255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.418087 20255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:30.418116 20255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.427526 20255 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:46285
I20260810 06:34:30.427551 20464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:46285 every 8 connection(s)
I20260810 06:34:30.428704 20255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:34:30.430176 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 20255
I20260810 06:34:30.430301 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:34:30.430644 22287 external_mini_cluster.cc:1428] Setting key 9d1afb3a97fb30357ee94075652e3464
I20260810 06:34:30.433049 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37373
--builtin_ntp_servers=127.21.195.212:43383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:34:30.440440 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.431051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:38723 (local address 127.21.195.254:37373)
0810 06:34:30.431202 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.431205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.432794 (+ 1589us) server_negotiation.cc:407] Connection header received
0810 06:34:30.434826 (+ 2032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.434829 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.434892 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.434991 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:30.436089 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.436846 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.438200 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.438554 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.438681 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.439882 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:30.439886 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:30.439890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:30.439908 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:30.439936 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:30.439947 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:30.440033 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.440167 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.440247 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:34:30.441393 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.431645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37373 (local address 127.21.195.194:38723)
0810 06:34:30.432610 (+ 965us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:30.432678 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:30.434549 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:30.435219 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:30.435235 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:30.435342 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:30.435925 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.435940 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.436993 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.436995 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.438054 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.438066 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.438722 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.438725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.438907 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.439564 (+ 657us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:30.439567 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:30.439619 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:30.439700 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:30.440031 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:30.440037 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:30.440041 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 06:34:30.440145 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 06:34:30.440430 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":180,"threads_started":1}
I20260810 06:34:30.442780 20466 heartbeater.cc:347] Connected to a master server at 127.21.195.254:37373
I20260810 06:34:30.443064 20466 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:30.443668 20466 heartbeater.cc:511] Master 127.21.195.254:37373 requested a full tablet report, sending...
I20260810 06:34:30.444854 19938 ts_manager.cc:194] Registered new tserver with Master: 2b72d0adf2b147e9a92f93def99aed0f (127.21.195.194:46285)
I20260810 06:34:30.445473 19938 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.194:38723
W20260810 06:34:30.560111 20470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:30.560436 20470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:30.560478 20470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:30.564944 20470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:30.565026 20470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:30.565086 20470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:34:30.570461 20470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:43383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:37373
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:30.571712 20470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:30.573302 20470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:34:30.584189 20470 server_base.cc:1034] running on GCE node
W20260810 06:34:30.584097 20481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:30.584138 20482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:30.584126 20487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:30.584877 20470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:30.585701 20470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:30.586896 20470 hybrid_clock.cc:648] HybridClock initialized: now 1786343670586871 us; error 39 us; skew 500 ppm
I20260810 06:34:30.589144 20470 webserver.cc:460] Webserver started at http://127.21.195.195:37461/ using document root <none> and password file <none>
I20260810 06:34:30.589890 20470 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:30.589973 20470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:30.590221 20470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:30.592669 20470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "b221b4b9e7fa40979edaad363202b240"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "0a9f312ed9fd3324e66c1f1e615bc7bd"
server_key_iv: "8061b05815035ac18b0122727f64fa25"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.593338 20470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "b221b4b9e7fa40979edaad363202b240"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "0a9f312ed9fd3324e66c1f1e615bc7bd"
server_key_iv: "8061b05815035ac18b0122727f64fa25"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.597780 20470 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260810 06:34:30.600739 20496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.602334 20470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:30.602463 20470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "b221b4b9e7fa40979edaad363202b240"
format_stamp: "Formatted at 2026-08-10 06:34:30 on dist-test-slave-7lbf"
server_key: "0a9f312ed9fd3324e66c1f1e615bc7bd"
server_key_iv: "8061b05815035ac18b0122727f64fa25"
server_key_version: "encryptionkey@0"
I20260810 06:34:30.602596 20470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:30.614538 20470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:30.615319 20470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:30.615520 20470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:30.616216 20470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:30.617296 20470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:30.617348 20470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.617394 20470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:30.617422 20470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:30.626698 20470 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:34369
I20260810 06:34:30.626722 20685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:34369 every 8 connection(s)
I20260810 06:34:30.627732 20470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:34:30.631753 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 20470
I20260810 06:34:30.631882 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:34:30.632164 22287 external_mini_cluster.cc:1428] Setting key 20b51b04f3d7190ecc4635344b71ed97
I20260810 06:34:30.637969 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.629854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:50785 (local address 127.21.195.254:37373)
0810 06:34:30.630005 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.630009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.631303 (+ 1294us) server_negotiation.cc:407] Connection header received
0810 06:34:30.632923 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.632926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.632985 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.633065 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:30.634199 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.634838 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.636026 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.636250 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.636328 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.637484 (+ 1156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:30.637488 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:30.637490 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:30.637504 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:30.637545 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:30.637556 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:30.637635 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.637779 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.637843 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:34:30.638958 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.630340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37373 (local address 127.21.195.195:50785)
0810 06:34:30.631137 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:30.631182 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:30.632649 (+ 1467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:30.633267 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:30.633274 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:30.633371 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:30.634048 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.634065 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.634966 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.634969 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.635917 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.635927 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.636376 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.636379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.636532 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.637184 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:30.637185 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:30.637233 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:30.637304 (+ 71us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:30.637641 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:30.637651 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:30.637656 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 06:34:30.637765 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 06:34:30.638055 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":184,"threads_started":1}
I20260810 06:34:30.640275 20686 heartbeater.cc:347] Connected to a master server at 127.21.195.254:37373
I20260810 06:34:30.640542 20686 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:30.641149 20686 heartbeater.cc:511] Master 127.21.195.254:37373 requested a full tablet report, sending...
I20260810 06:34:30.642429 19938 ts_manager.cc:194] Registered new tserver with Master: b221b4b9e7fa40979edaad363202b240 (127.21.195.195:34369)
I20260810 06:34:30.643033 19938 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.195:50785
I20260810 06:34:30.646485 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:34:30.652878 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.648583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33342 (local address 127.21.195.254:37373)
0810 06:34:30.648732 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.648738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.648913 (+ 175us) server_negotiation.cc:407] Connection header received
0810 06:34:30.649058 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.649061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.649111 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.649174 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:30.649478 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.650069 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.650995 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.651228 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.651329 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.652302 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:30.652314 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:30.652316 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:30.652330 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:30.652352 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:30.652359 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:30.652486 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.652649 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.652698 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:34:30.656345 19938 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33342:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:34:30.659718 19938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:34:30.675690 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.670146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:34369 (local address 127.0.0.1:40326)
0810 06:34:30.670791 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:30.670803 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:30.670881 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:30.671578 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:30.671581 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:30.671604 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:30.671699 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.671705 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.672698 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.672701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.673992 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.674004 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.675077 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.675081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.675202 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.675242 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 06:34:30.675365 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 06:34:30.675520 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"spinlock_wait_cycles":768,"thread_start_us":106,"threads_started":1}
I20260810 06:34:30.675745 20714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.670382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40326 (local address 127.21.195.195:34369)
0810 06:34:30.671114 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.671125 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.671144 (+ 19us) server_negotiation.cc:407] Connection header received
0810 06:34:30.671206 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.671210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.671375 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.671512 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:30.671815 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.672579 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.674140 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.674959 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.675079 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.675294 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.675485 (+ 191us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.675598 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":186,"threads_started":1}
I20260810 06:34:30.675879 20703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.669295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46285 (local address 127.0.0.1:38494)
0810 06:34:30.669801 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:30.669858 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:30.670005 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:30.671506 (+ 1501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:30.671510 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:30.671527 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:30.671680 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.671688 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.673225 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.673229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.674262 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.674273 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.675370 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.675374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.675490 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.675513 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 06:34:30.675565 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 06:34:30.675637 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":25,"spinlock_wait_cycles":1920,"thread_start_us":118,"threads_started":1}
I20260810 06:34:30.676267 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.669461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38494 (local address 127.21.195.194:46285)
0810 06:34:30.670806 (+ 1345us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.670820 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.671040 (+ 220us) server_negotiation.cc:407] Connection header received
0810 06:34:30.671130 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.671136 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.671338 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.671826 (+ 488us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:30.671985 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.673086 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.674411 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.675222 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.675780 (+ 558us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.675979 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.676033 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.676120 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1226,"thread_start_us":146,"threads_started":1}
I20260810 06:34:30.676537 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.669458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:36495 (local address 127.0.0.1:35460)
0810 06:34:30.670473 (+ 1015us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:30.670488 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:30.670601 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:30.671414 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:30.671420 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:30.671442 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:30.671604 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.671612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.673290 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.673293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.674387 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.674409 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.675372 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.675375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.676266 (+ 891us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.676285 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 06:34:30.676352 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 06:34:30.676418 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"mutex_wait_us":794,"thread_start_us":142,"threads_started":1}
I20260810 06:34:30.676685 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.670214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35460 (local address 127.21.195.193:36495)
0810 06:34:30.670936 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.670948 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.670976 (+ 28us) server_negotiation.cc:407] Connection header received
0810 06:34:30.671056 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.671061 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.671256 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.671401 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:30.671736 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.672988 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.674521 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.675253 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.675374 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.675573 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.676425 (+ 852us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.676534 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":148,"threads_started":1}
I20260810 06:34:30.679490 20141 tablet_service.cc:1467] Processing CreateTablet for tablet efe6261776ad48749705361dcc5bb32a (DEFAULT_TABLE table=test-table [id=18af362fe51c4a339d557ef5e220ca7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:30.679514 20571 tablet_service.cc:1467] Processing CreateTablet for tablet efe6261776ad48749705361dcc5bb32a (DEFAULT_TABLE table=test-table [id=18af362fe51c4a339d557ef5e220ca7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:30.679515 20352 tablet_service.cc:1467] Processing CreateTablet for tablet efe6261776ad48749705361dcc5bb32a (DEFAULT_TABLE table=test-table [id=18af362fe51c4a339d557ef5e220ca7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:30.680639 20141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe6261776ad48749705361dcc5bb32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:30.680647 20571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe6261776ad48749705361dcc5bb32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:30.680647 20352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe6261776ad48749705361dcc5bb32a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:30.688941 20715 tablet_bootstrap.cc:492] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Bootstrap starting.
I20260810 06:34:30.689435 20717 tablet_bootstrap.cc:492] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29: Bootstrap starting.
I20260810 06:34:30.690256 20720 tablet_bootstrap.cc:492] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Bootstrap starting.
I20260810 06:34:30.691892 20717 tablet_bootstrap.cc:654] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:30.692718 20720 tablet_bootstrap.cc:654] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:30.692718 20715 tablet_bootstrap.cc:654] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:30.692709 20717 log.cc:824] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:30.693682 20720 log.cc:824] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:30.693682 20715 log.cc:824] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:30.695542 20717 tablet_bootstrap.cc:492] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29: No bootstrap required, opened a new log
I20260810 06:34:30.695761 20717 ts_tablet_manager.cc:1397] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260810 06:34:30.695858 20720 tablet_bootstrap.cc:492] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: No bootstrap required, opened a new log
I20260810 06:34:30.695858 20715 tablet_bootstrap.cc:492] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: No bootstrap required, opened a new log
I20260810 06:34:30.696062 20720 ts_tablet_manager.cc:1397] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260810 06:34:30.696062 20715 ts_tablet_manager.cc:1397] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260810 06:34:30.699301 20717 raft_consensus.cc:348] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.699570 20717 raft_consensus.cc:374] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:30.699640 20717 raft_consensus.cc:729] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b90503003dcd4ba7919646f85a1edf29, State: Initialized, Role: FOLLOWER
I20260810 06:34:30.700174 20717 consensus_queue.cc:260] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.700399 20715 raft_consensus.cc:348] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.700407 20720 raft_consensus.cc:348] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.700686 20715 raft_consensus.cc:374] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:30.700686 20720 raft_consensus.cc:374] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:30.700745 20715 raft_consensus.cc:729] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b72d0adf2b147e9a92f93def99aed0f, State: Initialized, Role: FOLLOWER
I20260810 06:34:30.700755 20720 raft_consensus.cc:729] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b221b4b9e7fa40979edaad363202b240, State: Initialized, Role: FOLLOWER
I20260810 06:34:30.701251 20715 consensus_queue.cc:260] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.701251 20720 consensus_queue.cc:260] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.701737 20717 ts_tablet_manager.cc:1428] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 06:34:30.702144 20250 heartbeater.cc:503] Master 127.21.195.254:37373 was elected leader, sending a full tablet report...
I20260810 06:34:30.702363 20715 ts_tablet_manager.cc:1428] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 06:34:30.702363 20720 ts_tablet_manager.cc:1428] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260810 06:34:30.702756 20466 heartbeater.cc:503] Master 127.21.195.254:37373 was elected leader, sending a full tablet report...
I20260810 06:34:30.702972 20686 heartbeater.cc:503] Master 127.21.195.254:37373 was elected leader, sending a full tablet report...
W20260810 06:34:30.712438 20251 tablet.cc:2369] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:34:30.878849 20687 tablet.cc:2369] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:34:30.902055 20733 raft_consensus.cc:482] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:30.902292 20733 raft_consensus.cc:504] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.903577 20733 leader_election.cc:288] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b90503003dcd4ba7919646f85a1edf29 (127.21.195.193:36495), b221b4b9e7fa40979edaad363202b240 (127.21.195.195:34369)
I20260810 06:34:30.907781 20714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.904023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:53763 (local address 127.21.195.195:34369)
0810 06:34:30.904148 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.904152 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.904415 (+ 263us) server_negotiation.cc:407] Connection header received
0810 06:34:30.904540 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.904543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.904591 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.904662 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:30.904953 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.905434 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.906737 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.907167 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.907301 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.907361 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.907559 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.907647 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:34:30.907781 20734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.903879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:34369 (local address 127.21.195.194:53763)
0810 06:34:30.904305 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:30.904318 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:30.904429 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:30.904682 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:30.904684 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:30.904700 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:30.904832 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.904839 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.905566 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.905570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.906608 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.906619 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.907292 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.907296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.907426 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.907451 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:34:30.907524 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 06:34:30.907597 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":182,"thread_start_us":78,"threads_started":1}
I20260810 06:34:30.907828 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.903978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:46021 (local address 127.21.195.193:36495)
0810 06:34:30.904115 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.904119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.904139 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:34:30.904294 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.904298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.904367 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.904450 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:30.904771 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.905352 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.906747 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.907174 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.907318 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.907370 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.907633 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.907720 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:34:30.907781 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.903879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:36495 (local address 127.21.195.194:46021)
0810 06:34:30.904023 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:30.904040 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:30.904154 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:30.904478 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:30.904482 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:30.904504 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:30.904639 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.904648 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.905467 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.905470 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.906597 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:30.906610 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.907307 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.907311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:30.907492 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.907513 (+ 21us) client_negotiation.cc:769] Sending connection context
0810 06:34:30.907591 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 06:34:30.907658 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":163}
I20260810 06:34:30.908625 20170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe6261776ad48749705361dcc5bb32a" candidate_uuid: "2b72d0adf2b147e9a92f93def99aed0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b90503003dcd4ba7919646f85a1edf29" is_pre_election: true
I20260810 06:34:30.908627 20608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe6261776ad48749705361dcc5bb32a" candidate_uuid: "2b72d0adf2b147e9a92f93def99aed0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b221b4b9e7fa40979edaad363202b240" is_pre_election: true
I20260810 06:34:30.909001 20170 raft_consensus.cc:2454] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b72d0adf2b147e9a92f93def99aed0f in term 0.
I20260810 06:34:30.909001 20608 raft_consensus.cc:2454] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b72d0adf2b147e9a92f93def99aed0f in term 0.
I20260810 06:34:30.909566 20273 leader_election.cc:302] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b72d0adf2b147e9a92f93def99aed0f, b90503003dcd4ba7919646f85a1edf29; no voters:
I20260810 06:34:30.909899 20733 raft_consensus.cc:2781] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:34:30.909998 20733 raft_consensus.cc:482] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:34:30.910048 20733 raft_consensus.cc:3037] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:30.911157 20733 raft_consensus.cc:504] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.911509 20733 leader_election.cc:288] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [CANDIDATE]: Term 1 election: Requested vote from peers b90503003dcd4ba7919646f85a1edf29 (127.21.195.193:36495), b221b4b9e7fa40979edaad363202b240 (127.21.195.195:34369)
I20260810 06:34:30.911944 20608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe6261776ad48749705361dcc5bb32a" candidate_uuid: "2b72d0adf2b147e9a92f93def99aed0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b221b4b9e7fa40979edaad363202b240"
I20260810 06:34:30.911944 20170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe6261776ad48749705361dcc5bb32a" candidate_uuid: "2b72d0adf2b147e9a92f93def99aed0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b90503003dcd4ba7919646f85a1edf29"
I20260810 06:34:30.912093 20608 raft_consensus.cc:3037] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:30.912093 20170 raft_consensus.cc:3037] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:30.913492 20608 raft_consensus.cc:2454] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b72d0adf2b147e9a92f93def99aed0f in term 1.
I20260810 06:34:30.913492 20170 raft_consensus.cc:2454] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b72d0adf2b147e9a92f93def99aed0f in term 1.
I20260810 06:34:30.913873 20273 leader_election.cc:302] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b72d0adf2b147e9a92f93def99aed0f, b90503003dcd4ba7919646f85a1edf29; no voters:
I20260810 06:34:30.914054 20733 raft_consensus.cc:2781] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:30.914300 20733 raft_consensus.cc:686] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 1 LEADER]: Becoming Leader. State: Replica: 2b72d0adf2b147e9a92f93def99aed0f, State: Running, Role: LEADER
I20260810 06:34:30.914654 20733 consensus_queue.cc:237] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } }
I20260810 06:34:30.918313 19935 catalog_manager.cc:5495] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b72d0adf2b147e9a92f93def99aed0f (127.21.195.194). New cstate: current_term: 1 leader_uuid: "2b72d0adf2b147e9a92f93def99aed0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b72d0adf2b147e9a92f93def99aed0f" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 } health_report { overall_health: UNKNOWN } } }
W20260810 06:34:30.929986 20467 tablet.cc:2369] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:34:30.975746 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:30.972122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38508 (local address 127.21.195.194:46285)
0810 06:34:30.972254 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:30.972258 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:30.972273 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:34:30.972355 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:30.972357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:30.972421 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:30.972519 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:34:30.972722 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.973276 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.974200 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:30.974438 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:30.974542 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:30.974818 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:34:30.975307 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:34:30.975432 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:30.975534 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 06:34:30.975577 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:34:30.982553 20170 raft_consensus.cc:1261] T efe6261776ad48749705361dcc5bb32a P b90503003dcd4ba7919646f85a1edf29 [term 1 FOLLOWER]: Refusing update from remote peer 2b72d0adf2b147e9a92f93def99aed0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:30.982553 20608 raft_consensus.cc:1261] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 1 FOLLOWER]: Refusing update from remote peer 2b72d0adf2b147e9a92f93def99aed0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:30.983299 20733 consensus_queue.cc:1035] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b90503003dcd4ba7919646f85a1edf29" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 36495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:30.983512 20735 consensus_queue.cc:1035] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b221b4b9e7fa40979edaad363202b240" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 34369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:31.003667 19937 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:31.003894 19937 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:31.006992 19937 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4bcfe3de828143d2ba5c6a6db03509c1: Sending DeleteTablet for 3 replicas of tablet efe6261776ad48749705361dcc5bb32a
I20260810 06:34:31.008082 20141 tablet_service.cc:1514] Processing DeleteTablet for tablet efe6261776ad48749705361dcc5bb32a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:30 UTC) from {username='slave'} at 127.0.0.1:35460
I20260810 06:34:31.008071 20352 tablet_service.cc:1514] Processing DeleteTablet for tablet efe6261776ad48749705361dcc5bb32a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:30 UTC) from {username='slave'} at 127.0.0.1:38494
I20260810 06:34:31.008749 20571 tablet_service.cc:1514] Processing DeleteTablet for tablet efe6261776ad48749705361dcc5bb32a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:30 UTC) from {username='slave'} at 127.0.0.1:40326
I20260810 06:34:31.008915 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 20048
I20260810 06:34:31.021708 20757 tablet_replica.cc:330] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: stopping tablet replica
I20260810 06:34:31.022195 20757 raft_consensus.cc:2229] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:31.022629 20757 raft_consensus.cc:2258] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:31.021790 20756 tablet_replica.cc:330] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: stopping tablet replica
I20260810 06:34:31.024432 20756 raft_consensus.cc:2229] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:34:31.026741 20756 raft_consensus.cc:2258] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:31.027640 20757 ts_tablet_manager.cc:1905] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:31.030275 20756 ts_tablet_manager.cc:1905] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:31.030953 20757 ts_tablet_manager.cc:1918] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:31.031073 20757 log.cc:1196] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/efe6261776ad48749705361dcc5bb32a
I20260810 06:34:31.031388 20757 ts_tablet_manager.cc:1939] T efe6261776ad48749705361dcc5bb32a P b221b4b9e7fa40979edaad363202b240: Deleting consensus metadata
I20260810 06:34:31.032945 19920 catalog_manager.cc:4841] TS b221b4b9e7fa40979edaad363202b240 (127.21.195.195:34369): tablet efe6261776ad48749705361dcc5bb32a (table test-table [id=18af362fe51c4a339d557ef5e220ca7d]) successfully deleted
I20260810 06:34:31.033730 20756 ts_tablet_manager.cc:1918] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:31.033864 20756 log.cc:1196] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/efe6261776ad48749705361dcc5bb32a
I20260810 06:34:31.034205 20756 ts_tablet_manager.cc:1939] T efe6261776ad48749705361dcc5bb32a P 2b72d0adf2b147e9a92f93def99aed0f: Deleting consensus metadata
W20260810 06:34:31.034337 19914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:36495 (error 108)
I20260810 06:34:31.034605 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 20255
I20260810 06:34:31.063946 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:31.063595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:36495 (local address 127.0.0.1:35466)
0810 06:34:31.063751 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:31.063846 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:36495: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260810 06:34:31.064162 19914 catalog_manager.cc:4584] TS b90503003dcd4ba7919646f85a1edf29 (127.21.195.193:36495): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet efe6261776ad48749705361dcc5bb32a: Network error: Client connection negotiation failed: client connection to 127.21.195.193:36495: connect: Connection refused (error 111)
I20260810 06:34:31.069604 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 20470
I20260810 06:34:31.075222 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:31.069801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46285 (local address 127.0.0.1:38522)
0810 06:34:31.074981 (+ 5180us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:31.075088 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.194:46285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5039}
I20260810 06:34:31.088963 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 19886
2026-08-10T06:34:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1400 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:31 dist-test-slave-7lbf krb5kdc[20763](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:31 dist-test-slave-7lbf krb5kdc[20763](info): set up 2 sockets
Aug 10 06:34:31 dist-test-slave-7lbf krb5kdc[20763](info): commencing operation
krb5kdc: starting...
W20260810 06:34:32.263759 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:32 dist-test-slave-7lbf krb5kdc[20763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:34:32.398959 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44399
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:44399
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:32.523344 20782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:32.523692 20782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:32.523757 20782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:32.528034 20782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:32.528126 20782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:32.528154 20782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:32.528177 20782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:32.528205 20782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:32.534117 20782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:44399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:32.535414 20782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:32.536644 20782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:32.546240 20794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:32.546243 20790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:32.546475 20782 server_base.cc:1034] running on GCE node
W20260810 06:34:32.546243 20791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:32.547281 20782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:32.548609 20782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:32.549787 20782 hybrid_clock.cc:648] HybridClock initialized: now 1786343672549763 us; error 36 us; skew 500 ppm
Aug 10 06:34:32 dist-test-slave-7lbf krb5kdc[20763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343672, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:32.552819 20782 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:34:32.553951 20782 webserver.cc:460] Webserver started at http://127.21.195.254:37727/ using document root <none> and password file <none>
I20260810 06:34:32.554594 20782 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:32.554670 20782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:32.554904 20782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:32.557235 20782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "d544326495134b088859430cb7a764f7"
format_stamp: "Formatted at 2026-08-10 06:34:32 on dist-test-slave-7lbf"
server_key: "f129640c133990d45095db2838f7b11f"
server_key_iv: "654d5ba076a3dc7fad07c4af5bee9c2e"
server_key_version: "encryptionkey@0"
I20260810 06:34:32.557926 20782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "d544326495134b088859430cb7a764f7"
format_stamp: "Formatted at 2026-08-10 06:34:32 on dist-test-slave-7lbf"
server_key: "f129640c133990d45095db2838f7b11f"
server_key_iv: "654d5ba076a3dc7fad07c4af5bee9c2e"
server_key_version: "encryptionkey@0"
I20260810 06:34:32.562307 20782 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:32.565131 20805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:32.566618 20782 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:34:32.566764 20782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "d544326495134b088859430cb7a764f7"
format_stamp: "Formatted at 2026-08-10 06:34:32 on dist-test-slave-7lbf"
server_key: "f129640c133990d45095db2838f7b11f"
server_key_iv: "654d5ba076a3dc7fad07c4af5bee9c2e"
server_key_version: "encryptionkey@0"
I20260810 06:34:32.566890 20782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:32.587291 20782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:32.590641 20782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:32.590862 20782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:32.598281 20782 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:44399
I20260810 06:34:32.598313 20889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:44399 every 8 connection(s)
I20260810 06:34:32.599380 20782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:32.602730 20890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:32.607429 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 20782
I20260810 06:34:32.607563 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:32.607831 22287 external_mini_cluster.cc:1428] Setting key db034e263913bafe7abff10212dd9b35
I20260810 06:34:32.609421 20890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7: Bootstrap starting.
I20260810 06:34:32.612294 20890 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:32.613150 20890 log.cc:824] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:32.615705 20890 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7: No bootstrap required, opened a new log
Aug 10 06:34:32 dist-test-slave-7lbf krb5kdc[20763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343672, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:32.620280 20890 raft_consensus.cc:348] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d544326495134b088859430cb7a764f7" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44399 } }
I20260810 06:34:32.620580 20890 raft_consensus.cc:374] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:32.620657 20890 raft_consensus.cc:729] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d544326495134b088859430cb7a764f7, State: Initialized, Role: FOLLOWER
I20260810 06:34:32.621153 20890 consensus_queue.cc:260] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d544326495134b088859430cb7a764f7" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44399 } }
I20260810 06:34:32.621304 20890 raft_consensus.cc:388] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:32.621376 20890 raft_consensus.cc:482] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:32.621495 20890 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:32.622661 20890 raft_consensus.cc:504] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d544326495134b088859430cb7a764f7" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44399 } }
I20260810 06:34:32.623035 20890 leader_election.cc:302] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d544326495134b088859430cb7a764f7; no voters:
I20260810 06:34:32.623375 20890 leader_election.cc:288] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:32.623479 20899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:32.623488 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:32.609402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53572 (local address 127.21.195.254:44399)
0810 06:34:32.609904 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:32.609921 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:32.609961 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:34:32.610686 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:32.610707 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:32.611090 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:32.611410 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:32.612371 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:32.613562 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:32.614721 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:32.615233 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:32.615373 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:32.618304 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:32.618310 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:32.618327 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:32.618361 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:32.620088 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:32.620545 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:32.620551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:32.620557 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:32.620755 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:32.621056 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:32.621059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:32.621061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:32.621655 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:32.621874 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:32.622182 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 06:34:32.622527 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":131,"threads_started":1}
I20260810 06:34:32.623660 20899 raft_consensus.cc:686] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [term 1 LEADER]: Becoming Leader. State: Replica: d544326495134b088859430cb7a764f7, State: Running, Role: LEADER
I20260810 06:34:32.624106 20899 consensus_queue.cc:237] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d544326495134b088859430cb7a764f7" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44399 } }
I20260810 06:34:32.624918 20890 sys_catalog.cc:564] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:32.626008 20900 sys_catalog.cc:455] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d544326495134b088859430cb7a764f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d544326495134b088859430cb7a764f7" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44399 } } }
I20260810 06:34:32.626471 20900 sys_catalog.cc:458] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:32.626356 20904 sys_catalog.cc:455] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d544326495134b088859430cb7a764f7. Latest consensus state: current_term: 1 leader_uuid: "d544326495134b088859430cb7a764f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d544326495134b088859430cb7a764f7" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44399 } } }
I20260810 06:34:32.626811 20904 sys_catalog.cc:458] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:32.627552 20922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:32.631006 20922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:32.637696 20922 catalog_manager.cc:1347] Generated new cluster ID: 62d9465643884657a99a6823ad9f20b6
I20260810 06:34:32.637795 20922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:32.650833 20922 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:32.652314 20922 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:32.667380 20922 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7: Generated new TSK 0
I20260810 06:34:32.668455 20922 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.195.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
Entry for principal kudu/127.21.195.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab.
I20260810 06:34:32.708751 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44399
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:32.836666 20938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:32.837001 20938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:32.837069 20938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:32.841385 20938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:32.841493 20938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:32.841611 20938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:34:32.847532 20938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.193.keytab
--principal=kudu/127.21.195.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:32.848840 20938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:32.850078 20938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:32.861151 20946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:32.861152 20945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:32.861253 20938 server_base.cc:1034] running on GCE node
W20260810 06:34:32.861151 20950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:32.861951 20938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:32.862720 20938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:32.863972 20938 hybrid_clock.cc:648] HybridClock initialized: now 1786343672863947 us; error 43 us; skew 500 ppm
Aug 10 06:34:32 dist-test-slave-7lbf krb5kdc[20763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343672, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:32.867247 20938 init.cc:377] Logged in from keytab as kudu/127.21.195.193@KRBTEST.COM (short username kudu)
I20260810 06:34:32.868281 20938 webserver.cc:460] Webserver started at http://127.21.195.193:43583/ using document root <none> and password file <none>
I20260810 06:34:32.868925 20938 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:32.869005 20938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:32.869239 20938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:32.871726 20938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "f21f91ba7ace4695a2f2784286fc4201"
format_stamp: "Formatted at 2026-08-10 06:34:32 on dist-test-slave-7lbf"
server_key: "885acd11d71300fbc4a3380714584944"
server_key_iv: "d18709aea3d16f0cef88abffc7aa02a4"
server_key_version: "encryptionkey@0"
I20260810 06:34:32.872362 20938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "f21f91ba7ace4695a2f2784286fc4201"
format_stamp: "Formatted at 2026-08-10 06:34:32 on dist-test-slave-7lbf"
server_key: "885acd11d71300fbc4a3380714584944"
server_key_iv: "d18709aea3d16f0cef88abffc7aa02a4"
server_key_version: "encryptionkey@0"
I20260810 06:34:32.876765 20938 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260810 06:34:32.879639 20962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:32.881068 20938 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 06:34:32.881211 20938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "f21f91ba7ace4695a2f2784286fc4201"
format_stamp: "Formatted at 2026-08-10 06:34:32 on dist-test-slave-7lbf"
server_key: "885acd11d71300fbc4a3380714584944"
server_key_iv: "d18709aea3d16f0cef88abffc7aa02a4"
server_key_version: "encryptionkey@0"
I20260810 06:34:32.881340 20938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:32.911314 20938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:32.914652 20938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:32.914889 20938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:32.915575 20938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:32.916559 20938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:32.916617 20938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:32.916678 20938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:32.916705 20938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:32.926056 20938 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:42183
I20260810 06:34:32.926093 21164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:42183 every 8 connection(s)
I20260810 06:34:32.927183 20938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:34:32.927954 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 20938
I20260810 06:34:32.928107 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:34:32.928463 22287 external_mini_cluster.cc:1428] Setting key a270e73bfd392ad1ee89122d3e72636e
WARNING: no policy specified for kudu/127.21.195.194@KRBTEST.COM; defaulting to no policy
Aug 10 06:34:32 dist-test-slave-7lbf krb5kdc[20763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343672, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.193@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.194@KRBTEST.COM" created.
I20260810 06:34:32.945403 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:32.929338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:33745 (local address 127.21.195.254:44399)
0810 06:34:32.929472 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:32.929475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:32.932538 (+ 3063us) server_negotiation.cc:407] Connection header received
0810 06:34:32.933976 (+ 1438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:32.933979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:32.934034 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:32.934125 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:32.935903 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:32.936437 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:32.938290 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:32.938531 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:32.938613 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:32.941639 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:32.941642 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:32.941645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:32.941678 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:32.943101 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:32.943679 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:32.943683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:32.943684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:32.943789 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:32.944136 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:32.944139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:32.944140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:32.944355 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:32.944455 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:32.945057 (+ 602us) server_negotiation.cc:299] Negotiation successful
0810 06:34:32.945216 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:34:32.946415 21167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:32.930007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44399 (local address 127.21.195.193:33745)
0810 06:34:32.932345 (+ 2338us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:32.932403 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:32.933726 (+ 1323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:32.934388 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:32.934400 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:32.934935 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:32.935710 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:32.935736 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:32.936590 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:32.936594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:32.938154 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:32.938169 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:32.938714 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:32.938718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:32.938948 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:32.939644 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:32.939669 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:32.941384 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:32.943212 (+ 1828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:32.943218 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:32.943234 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:32.943570 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:32.943874 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:32.943876 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:32.943878 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:32.944028 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:32.944481 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:32.944490 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:32.944779 (+ 289us) client_negotiation.cc:769] Sending connection context
0810 06:34:32.944972 (+ 193us) client_negotiation.cc:240] Negotiation successful
0810 06:34:32.945362 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2100,"thread_start_us":112,"threads_started":1}
I20260810 06:34:32.947824 21165 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44399
I20260810 06:34:32.948096 21165 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:32.948673 21165 heartbeater.cc:511] Master 127.21.195.254:44399 requested a full tablet report, sending...
I20260810 06:34:32.950444 20833 ts_manager.cc:194] Registered new tserver with Master: f21f91ba7ace4695a2f2784286fc4201 (127.21.195.193:42183)
I20260810 06:34:32.951710 20833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.193@KRBTEST.COM'} at 127.21.195.193:33745
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
Entry for principal kudu/127.21.195.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab.
I20260810 06:34:32.960053 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44399
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:33.083879 21172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:33.084208 21172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:33.084254 21172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:33.088563 21172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:33.088649 21172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:33.088714 21172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:34:33.094506 21172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.194.keytab
--principal=kudu/127.21.195.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:33.095707 21172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:33.096837 21172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:33.107630 21182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:33.107788 21172 server_base.cc:1034] running on GCE node
W20260810 06:34:33.107631 21180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:33.107631 21184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:33.108445 21172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:33.109156 21172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:33.110334 21172 hybrid_clock.cc:648] HybridClock initialized: now 1786343673110307 us; error 38 us; skew 500 ppm
Aug 10 06:34:33 dist-test-slave-7lbf krb5kdc[20763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343673, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:33.113329 21172 init.cc:377] Logged in from keytab as kudu/127.21.195.194@KRBTEST.COM (short username kudu)
I20260810 06:34:33.114483 21172 webserver.cc:460] Webserver started at http://127.21.195.194:36113/ using document root <none> and password file <none>
I20260810 06:34:33.115139 21172 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:33.115219 21172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:33.115473 21172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:33.117877 21172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "a722ed7e6c534f97a6e38da419387ab8"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "2418c1c8e65611e538af2fee07d0dbb5"
server_key_iv: "81a9eb0c1cf3accafa0e82b9f41ff386"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.118533 21172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "a722ed7e6c534f97a6e38da419387ab8"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "2418c1c8e65611e538af2fee07d0dbb5"
server_key_iv: "81a9eb0c1cf3accafa0e82b9f41ff386"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.123054 21172 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260810 06:34:33.125861 21194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:33.127373 21172 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:34:33.127521 21172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "a722ed7e6c534f97a6e38da419387ab8"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "2418c1c8e65611e538af2fee07d0dbb5"
server_key_iv: "81a9eb0c1cf3accafa0e82b9f41ff386"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.127638 21172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:33.144368 21172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:33.147966 21172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:33.148181 21172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:33.148885 21172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:33.149923 21172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:33.149976 21172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:33.150036 21172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:33.150065 21172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:33.159499 21172 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:40935
I20260810 06:34:33.159543 21381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:40935 every 8 connection(s)
I20260810 06:34:33.160581 21172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:34:33.170197 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 21172
I20260810 06:34:33.170351 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:34:33.170698 22287 external_mini_cluster.cc:1428] Setting key 0e32ebe2cc7c3bcf128505c42dfaf19f
Aug 10 06:34:33 dist-test-slave-7lbf krb5kdc[20763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343673, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.194@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:33.179813 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.163396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:54053 (local address 127.21.195.254:44399)
0810 06:34:33.163598 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.163603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.164664 (+ 1061us) server_negotiation.cc:407] Connection header received
0810 06:34:33.166352 (+ 1688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.166357 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.166429 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.166571 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:33.168443 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.169006 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.171452 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.171785 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.171898 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.175307 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:33.175312 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:33.175316 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:33.175354 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:33.177155 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:33.177864 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:33.177868 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:33.177870 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:33.177978 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:33.178403 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:33.178406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:33.178408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:33.178641 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:33.178739 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.179442 (+ 703us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.179627 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 06:34:33.180891 21387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.163907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44399 (local address 127.21.195.194:54053)
0810 06:34:33.164461 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:33.164523 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:33.166053 (+ 1530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:33.166840 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:33.166852 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:33.167589 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:33.168247 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.168264 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.169156 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.169158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.171257 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.171272 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.172107 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.172112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.172354 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.173075 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:33.173096 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:33.175056 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:33.177290 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:33.177296 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:33.177313 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:33.177735 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:33.178075 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:33.178078 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:33.178080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:33.178289 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:33.178752 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:33.178760 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:33.179147 (+ 387us) client_negotiation.cc:769] Sending connection context
0810 06:34:33.179367 (+ 220us) client_negotiation.cc:240] Negotiation successful
0810 06:34:33.179781 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":132,"threads_started":1}
I20260810 06:34:33.186012 21383 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44399
I20260810 06:34:33.186419 21383 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:33.187093 21383 heartbeater.cc:511] Master 127.21.195.254:44399 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.21.195.195@KRBTEST.COM; defaulting to no policy
I20260810 06:34:33.188334 20833 ts_manager.cc:194] Registered new tserver with Master: a722ed7e6c534f97a6e38da419387ab8 (127.21.195.194:40935)
I20260810 06:34:33.188990 20833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.194@KRBTEST.COM'} at 127.21.195.194:54053
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
Entry for principal kudu/127.21.195.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab.
I20260810 06:34:33.210443 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44399
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:44291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:33.339085 21390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:33.339396 21390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:33.339443 21390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:33.343766 21390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:33.343871 21390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:33.343971 21390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:34:33.349828 21390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:44291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.195.keytab
--principal=kudu/127.21.195.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:44399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:33.351125 21390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:33.352290 21390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:33.363463 21397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:33.363487 21401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:33.363735 21390 server_base.cc:1034] running on GCE node
W20260810 06:34:33.363867 21398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:33.364468 21390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:33.365479 21390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:33.366726 21390 hybrid_clock.cc:648] HybridClock initialized: now 1786343673366672 us; error 78 us; skew 500 ppm
Aug 10 06:34:33 dist-test-slave-7lbf krb5kdc[20763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343673, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:33.371233 21390 init.cc:377] Logged in from keytab as kudu/127.21.195.195@KRBTEST.COM (short username kudu)
I20260810 06:34:33.372816 21390 webserver.cc:460] Webserver started at http://127.21.195.195:33657/ using document root <none> and password file <none>
I20260810 06:34:33.373764 21390 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:33.373880 21390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:33.374168 21390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:33.377612 21390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "4e838d8a1e304f58bcd75e76d1417605"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "3b76aaf2ca1a757a17565239f0500b83"
server_key_iv: "e51cf05413b01eb412bf2eaf7723fd9f"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.378553 21390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "4e838d8a1e304f58bcd75e76d1417605"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "3b76aaf2ca1a757a17565239f0500b83"
server_key_iv: "e51cf05413b01eb412bf2eaf7723fd9f"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.390235 21390 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.005s sys 0.001s
I20260810 06:34:33.393687 21412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:33.395256 21390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:33.395401 21390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "4e838d8a1e304f58bcd75e76d1417605"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "3b76aaf2ca1a757a17565239f0500b83"
server_key_iv: "e51cf05413b01eb412bf2eaf7723fd9f"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.395545 21390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:33.418568 21390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:33.421967 21390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:33.422181 21390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:33.422873 21390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:33.423835 21390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:33.423889 21390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:33.423941 21390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:33.423971 21390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:33.433488 21390 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:45621
I20260810 06:34:33.433534 21590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:45621 every 8 connection(s)
I20260810 06:34:33.434572 21390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:34:33.440172 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 21390
I20260810 06:34:33.440347 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:34:33.440697 22287 external_mini_cluster.cc:1428] Setting key 115c80d8e0305f503d7c7813da7a21a9
Aug 10 06:34:33 dist-test-slave-7lbf krb5kdc[20763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343673, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.195@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:33.449312 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.436580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:52915 (local address 127.21.195.254:44399)
0810 06:34:33.436720 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.436724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.437773 (+ 1049us) server_negotiation.cc:407] Connection header received
0810 06:34:33.439191 (+ 1418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.439196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.439261 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.439337 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:33.441128 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.441869 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.443113 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.443338 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.443421 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.446046 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:33.446050 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:33.446052 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:33.446080 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:33.447390 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:33.447903 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:33.447906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:33.447907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:33.447999 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:33.448285 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:33.448287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:33.448288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:33.448470 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:33.448542 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.449045 (+ 503us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.449172 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 06:34:33.450284 21593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.437010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:44399 (local address 127.21.195.195:52915)
0810 06:34:33.437596 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:33.437659 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:33.438936 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:33.439569 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:33.439578 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:33.440082 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:33.440899 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.440925 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.442010 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.442014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.442988 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.442999 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.443473 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.443486 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.443657 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.444224 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:34:33.444243 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:33.445858 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:33.447510 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:33.447517 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:33.447534 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:33.447823 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:33.448065 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:34:33.448067 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:34:33.448069 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:34:33.448219 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:34:33.448541 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:33.448547 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:33.448833 (+ 286us) client_negotiation.cc:769] Sending connection context
0810 06:34:33.449011 (+ 178us) client_negotiation.cc:240] Negotiation successful
0810 06:34:33.449317 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":141,"threads_started":1}
I20260810 06:34:33.451567 21591 heartbeater.cc:347] Connected to a master server at 127.21.195.254:44399
I20260810 06:34:33.451823 21591 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:33.452349 21591 heartbeater.cc:511] Master 127.21.195.254:44399 requested a full tablet report, sending...
I20260810 06:34:33.453507 20833 ts_manager.cc:194] Registered new tserver with Master: 4e838d8a1e304f58bcd75e76d1417605 (127.21.195.195:45621)
I20260810 06:34:33.454160 20833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.195.195@KRBTEST.COM'} at 127.21.195.195:52915
I20260810 06:34:33.454937 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:34:33.464166 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.457315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53582 (local address 127.21.195.254:44399)
0810 06:34:33.457442 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.457446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.457651 (+ 205us) server_negotiation.cc:407] Connection header received
0810 06:34:33.457745 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.457747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.457805 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.457871 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:33.458580 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.459099 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.459890 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.460102 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.460174 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.461485 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:33.461489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:33.461491 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:33.461537 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:33.462701 (+ 1164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:33.463123 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:33.463125 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:33.463126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:33.463202 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:33.463402 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:33.463404 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:33.463405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:33.463627 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:33.463737 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.463912 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.464030 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:34:33.467236 20833 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:34:33.470809 20833 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:34:33.486616 21611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.480245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:42183 (local address 127.0.0.1:33880)
0810 06:34:33.480773 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:33.480829 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:33.480965 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:33.481967 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:33.481974 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:33.481999 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:33.482168 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.482176 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.483434 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.483437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.484678 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.484689 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.485967 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.485971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.486089 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.486135 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 06:34:33.486264 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 06:34:33.486418 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":1,"thread_start_us":129,"threads_started":1}
I20260810 06:34:33.486773 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.481621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.21.195.195:45621)
0810 06:34:33.482096 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.482107 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.482127 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:34:33.482200 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.482204 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.482386 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.482547 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:33.482753 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.483825 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.485277 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.486145 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.486258 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.486398 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.486532 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.486632 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":153,"threads_started":1}
I20260810 06:34:33.487066 21612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.480549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44180 (local address 127.21.195.194:40935)
0810 06:34:33.481010 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.481023 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.481461 (+ 438us) server_negotiation.cc:407] Connection header received
0810 06:34:33.481745 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.481752 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.481962 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.482107 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:33.482593 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.483800 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.485454 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.486239 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.486348 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.486486 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.486804 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.486925 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":153,"threads_started":1}
I20260810 06:34:33.487087 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.481126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45621 (local address 127.0.0.1:50008)
0810 06:34:33.481456 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:33.481469 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:33.481590 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:33.482532 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:33.482535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:33.482553 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:33.482636 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.482642 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.483971 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.483975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.485139 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.485150 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.486299 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.486302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.486400 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.486425 (+ 25us) client_negotiation.cc:769] Sending connection context
0810 06:34:33.486496 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:34:33.486573 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":29,"thread_start_us":112,"threads_started":1}
I20260810 06:34:33.487524 21608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.480353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:40935 (local address 127.0.0.1:44180)
0810 06:34:33.481332 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:33.481347 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:33.481574 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:33.482313 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:33.482315 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:33.482333 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:33.482461 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.482468 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.483976 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.483979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.485311 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.485321 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.486552 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.486555 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.486639 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.486661 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 06:34:33.487273 (+ 612us) client_negotiation.cc:240] Negotiation successful
0810 06:34:33.487360 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":918,"mutex_wait_us":348,"thread_start_us":126,"threads_started":1}
I20260810 06:34:33.487535 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.481070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33880 (local address 127.21.195.193:42183)
0810 06:34:33.481359 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.481367 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.481393 (+ 26us) server_negotiation.cc:407] Connection header received
0810 06:34:33.481494 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.481501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.481796 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.482327 (+ 531us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:33.482486 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.483324 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.484824 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.485840 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.485985 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.486147 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.487268 (+ 1121us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.487388 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":101,"threads_started":1}
I20260810 06:34:33.490450 21483 tablet_service.cc:1467] Processing CreateTablet for tablet 60529d5dece14496aac1f7f32fbe798d (DEFAULT_TABLE table=test-table [id=a04d0b2e615d4fb0ac235029d0a4641e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:33.490466 21276 tablet_service.cc:1467] Processing CreateTablet for tablet 60529d5dece14496aac1f7f32fbe798d (DEFAULT_TABLE table=test-table [id=a04d0b2e615d4fb0ac235029d0a4641e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:33.490461 21044 tablet_service.cc:1467] Processing CreateTablet for tablet 60529d5dece14496aac1f7f32fbe798d (DEFAULT_TABLE table=test-table [id=a04d0b2e615d4fb0ac235029d0a4641e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:33.491590 21483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60529d5dece14496aac1f7f32fbe798d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:33.491596 21276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60529d5dece14496aac1f7f32fbe798d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:33.491596 21044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60529d5dece14496aac1f7f32fbe798d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:33.498704 21617 tablet_bootstrap.cc:492] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: Bootstrap starting.
I20260810 06:34:33.500228 21620 tablet_bootstrap.cc:492] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201: Bootstrap starting.
I20260810 06:34:33.500201 21621 tablet_bootstrap.cc:492] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: Bootstrap starting.
I20260810 06:34:33.501459 21617 tablet_bootstrap.cc:654] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:33.502651 21617 log.cc:824] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:33.502729 21621 tablet_bootstrap.cc:654] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:33.502729 21620 tablet_bootstrap.cc:654] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:33.503700 21620 log.cc:824] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:33.503957 21621 log.cc:824] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:33.505331 21617 tablet_bootstrap.cc:492] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: No bootstrap required, opened a new log
I20260810 06:34:33.505621 21617 ts_tablet_manager.cc:1397] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260810 06:34:33.505944 21621 tablet_bootstrap.cc:492] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: No bootstrap required, opened a new log
I20260810 06:34:33.506073 21620 tablet_bootstrap.cc:492] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201: No bootstrap required, opened a new log
I20260810 06:34:33.506155 21621 ts_tablet_manager.cc:1397] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:34:33.506276 21620 ts_tablet_manager.cc:1397] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260810 06:34:33.509169 21621 raft_consensus.cc:348] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.509434 21621 raft_consensus.cc:374] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:33.509534 21621 raft_consensus.cc:729] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a722ed7e6c534f97a6e38da419387ab8, State: Initialized, Role: FOLLOWER
I20260810 06:34:33.509866 21617 raft_consensus.cc:348] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.510056 21621 consensus_queue.cc:260] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.510185 21617 raft_consensus.cc:374] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:33.510264 21617 raft_consensus.cc:729] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e838d8a1e304f58bcd75e76d1417605, State: Initialized, Role: FOLLOWER
I20260810 06:34:33.510854 21617 consensus_queue.cc:260] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.510787 21620 raft_consensus.cc:348] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.511093 21620 raft_consensus.cc:374] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:33.511186 21620 raft_consensus.cc:729] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f21f91ba7ace4695a2f2784286fc4201, State: Initialized, Role: FOLLOWER
I20260810 06:34:33.511308 21621 ts_tablet_manager.cc:1428] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 06:34:33.511658 21620 consensus_queue.cc:260] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.511832 21383 heartbeater.cc:503] Master 127.21.195.254:44399 was elected leader, sending a full tablet report...
I20260810 06:34:33.511996 21617 ts_tablet_manager.cc:1428] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260810 06:34:33.512238 21591 heartbeater.cc:503] Master 127.21.195.254:44399 was elected leader, sending a full tablet report...
I20260810 06:34:33.512765 21165 heartbeater.cc:503] Master 127.21.195.254:44399 was elected leader, sending a full tablet report...
I20260810 06:34:33.512748 21620 ts_tablet_manager.cc:1428] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 06:34:33.554523 21628 raft_consensus.cc:482] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:33.554764 21628 raft_consensus.cc:504] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.556252 21628 leader_election.cc:288] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f21f91ba7ace4695a2f2784286fc4201 (127.21.195.193:42183), 4e838d8a1e304f58bcd75e76d1417605 (127.21.195.195:45621)
I20260810 06:34:33.560940 21613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.556636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:38705 (local address 127.21.195.193:42183)
0810 06:34:33.556897 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.556902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.557213 (+ 311us) server_negotiation.cc:407] Connection header received
0810 06:34:33.557286 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.557288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.557338 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.557419 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:33.557712 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.558397 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.559705 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.560323 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.560442 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.560492 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.560721 (+ 229us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.560811 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260810 06:34:33.560938 21615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.556663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:34407 (local address 127.21.195.195:45621)
0810 06:34:33.556829 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.556834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.556856 (+ 22us) server_negotiation.cc:407] Connection header received
0810 06:34:33.556922 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.556925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.556986 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.557064 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:33.557374 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.558172 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.559613 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.560259 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.560392 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.560454 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.560706 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.560807 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:34:33.560940 21387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.556550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45621 (local address 127.21.195.194:34407)
0810 06:34:33.556692 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:33.556707 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:33.556821 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:33.557100 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:33.557103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:33.557126 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:33.557263 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.557269 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.558306 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.558309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.559484 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.559496 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.560391 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.560395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.560508 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.560554 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 06:34:33.560641 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 06:34:33.560752 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":63}
I20260810 06:34:33.560946 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.556553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:42183 (local address 127.21.195.194:38705)
0810 06:34:33.557102 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:33.557116 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:33.557210 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:33.557431 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:33.557434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:33.557452 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:33.557596 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.557603 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.558520 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.558523 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.559580 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:33.559592 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.560441 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.560445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:33.560565 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.560582 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 06:34:33.560653 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 06:34:33.560752 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":206,"thread_start_us":157,"threads_started":1}
I20260810 06:34:33.561717 21517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60529d5dece14496aac1f7f32fbe798d" candidate_uuid: "a722ed7e6c534f97a6e38da419387ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e838d8a1e304f58bcd75e76d1417605" is_pre_election: true
I20260810 06:34:33.561767 21078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60529d5dece14496aac1f7f32fbe798d" candidate_uuid: "a722ed7e6c534f97a6e38da419387ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f21f91ba7ace4695a2f2784286fc4201" is_pre_election: true
I20260810 06:34:33.562070 21517 raft_consensus.cc:2454] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722ed7e6c534f97a6e38da419387ab8 in term 0.
I20260810 06:34:33.562090 21078 raft_consensus.cc:2454] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a722ed7e6c534f97a6e38da419387ab8 in term 0.
I20260810 06:34:33.562609 21200 leader_election.cc:302] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4e838d8a1e304f58bcd75e76d1417605, a722ed7e6c534f97a6e38da419387ab8, f21f91ba7ace4695a2f2784286fc4201; no voters:
I20260810 06:34:33.562904 21628 raft_consensus.cc:2781] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:34:33.563001 21628 raft_consensus.cc:482] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:34:33.563056 21628 raft_consensus.cc:3037] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:33.564183 21628 raft_consensus.cc:504] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.564553 21628 leader_election.cc:288] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [CANDIDATE]: Term 1 election: Requested vote from peers f21f91ba7ace4695a2f2784286fc4201 (127.21.195.193:42183), 4e838d8a1e304f58bcd75e76d1417605 (127.21.195.195:45621)
I20260810 06:34:33.564997 21517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60529d5dece14496aac1f7f32fbe798d" candidate_uuid: "a722ed7e6c534f97a6e38da419387ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e838d8a1e304f58bcd75e76d1417605"
I20260810 06:34:33.565037 21078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60529d5dece14496aac1f7f32fbe798d" candidate_uuid: "a722ed7e6c534f97a6e38da419387ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f21f91ba7ace4695a2f2784286fc4201"
I20260810 06:34:33.565124 21517 raft_consensus.cc:3037] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:33.565176 21078 raft_consensus.cc:3037] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:33.566323 21517 raft_consensus.cc:2454] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722ed7e6c534f97a6e38da419387ab8 in term 1.
I20260810 06:34:33.566345 21078 raft_consensus.cc:2454] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a722ed7e6c534f97a6e38da419387ab8 in term 1.
I20260810 06:34:33.566666 21200 leader_election.cc:302] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4e838d8a1e304f58bcd75e76d1417605, a722ed7e6c534f97a6e38da419387ab8; no voters:
I20260810 06:34:33.566857 21628 raft_consensus.cc:2781] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:33.567112 21628 raft_consensus.cc:686] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 1 LEADER]: Becoming Leader. State: Replica: a722ed7e6c534f97a6e38da419387ab8, State: Running, Role: LEADER
I20260810 06:34:33.567476 21628 consensus_queue.cc:237] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } }
I20260810 06:34:33.571066 20831 catalog_manager.cc:5495] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a722ed7e6c534f97a6e38da419387ab8 (127.21.195.194). New cstate: current_term: 1 leader_uuid: "a722ed7e6c534f97a6e38da419387ab8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a722ed7e6c534f97a6e38da419387ab8" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 40935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 } health_report { overall_health: UNKNOWN } } }
I20260810 06:34:33.587560 21612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.583822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44194 (local address 127.21.195.194:40935)
0810 06:34:33.583960 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.583964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.583980 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:34:33.584076 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.584078 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.584142 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.584244 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:34:33.584520 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.585051 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.585973 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.586200 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.586292 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.586619 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:34:33.587097 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:34:33.587220 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.587306 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.587376 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:34:33.594300 21517 raft_consensus.cc:1261] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 1 FOLLOWER]: Refusing update from remote peer a722ed7e6c534f97a6e38da419387ab8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:33.594300 21078 raft_consensus.cc:1261] T 60529d5dece14496aac1f7f32fbe798d P f21f91ba7ace4695a2f2784286fc4201 [term 1 FOLLOWER]: Refusing update from remote peer a722ed7e6c534f97a6e38da419387ab8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:33.595085 21628 consensus_queue.cc:1035] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f21f91ba7ace4695a2f2784286fc4201" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:33.595284 21633 consensus_queue.cc:1035] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e838d8a1e304f58bcd75e76d1417605" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:33.604998 21637 mvcc.cc:205] Tried to move back new op lower bound from 7316863687033344000 to 7316863686935453696. Current Snapshot: MvccSnapshot[applied={T|T < 7316863687033344000}]
I20260810 06:34:33.606391 21639 mvcc.cc:205] Tried to move back new op lower bound from 7316863687033344000 to 7316863686935453696. Current Snapshot: MvccSnapshot[applied={T|T < 7316863687033344000}]
I20260810 06:34:33.606706 21638 mvcc.cc:205] Tried to move back new op lower bound from 7316863687033344000 to 7316863686935453696. Current Snapshot: MvccSnapshot[applied={T|T < 7316863687033344000}]
I20260810 06:34:33.615931 20831 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:33.616134 20831 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:33.618963 20831 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d544326495134b088859430cb7a764f7: Sending DeleteTablet for 3 replicas of tablet 60529d5dece14496aac1f7f32fbe798d
I20260810 06:34:33.619972 21044 tablet_service.cc:1514] Processing DeleteTablet for tablet 60529d5dece14496aac1f7f32fbe798d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:33 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:33880
I20260810 06:34:33.620049 21276 tablet_service.cc:1514] Processing DeleteTablet for tablet 60529d5dece14496aac1f7f32fbe798d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:33 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:44180
I20260810 06:34:33.620285 21483 tablet_service.cc:1514] Processing DeleteTablet for tablet 60529d5dece14496aac1f7f32fbe798d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:33 UTC) from {username='kudu', principal='kudu/127.21.195.254@KRBTEST.COM'} at 127.0.0.1:50008
I20260810 06:34:33.620911 21658 tablet_replica.cc:330] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: stopping tablet replica
I20260810 06:34:33.621258 21658 raft_consensus.cc:2229] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:33.621501 21649 tablet_replica.cc:330] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: stopping tablet replica
I20260810 06:34:33.621646 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 20938
I20260810 06:34:33.621680 21658 raft_consensus.cc:2258] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:33.638415 21658 ts_tablet_manager.cc:1905] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:33.642292 21658 ts_tablet_manager.cc:1918] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:33.642472 21658 log.cc:1196] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/60529d5dece14496aac1f7f32fbe798d
I20260810 06:34:33.642930 21658 ts_tablet_manager.cc:1939] T 60529d5dece14496aac1f7f32fbe798d P 4e838d8a1e304f58bcd75e76d1417605: Deleting consensus metadata
I20260810 06:34:33.644565 20807 catalog_manager.cc:4841] TS 4e838d8a1e304f58bcd75e76d1417605 (127.21.195.195:45621): tablet 60529d5dece14496aac1f7f32fbe798d (table test-table [id=a04d0b2e615d4fb0ac235029d0a4641e]) successfully deleted
I20260810 06:34:33.646613 21649 raft_consensus.cc:2229] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 06:34:33.647075 21649 raft_consensus.cc:2258] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:33.648697 21649 ts_tablet_manager.cc:1905] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:33.651284 21649 ts_tablet_manager.cc:1918] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:33.651402 21649 log.cc:1196] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/60529d5dece14496aac1f7f32fbe798d
I20260810 06:34:33.651722 21649 ts_tablet_manager.cc:1939] T 60529d5dece14496aac1f7f32fbe798d P a722ed7e6c534f97a6e38da419387ab8: Deleting consensus metadata
I20260810 06:34:33.653055 20807 catalog_manager.cc:4841] TS a722ed7e6c534f97a6e38da419387ab8 (127.21.195.194:40935): tablet 60529d5dece14496aac1f7f32fbe798d (table test-table [id=a04d0b2e615d4fb0ac235029d0a4641e]) successfully deleted
W20260810 06:34:33.654259 20806 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:42183 (error 108)
I20260810 06:34:33.654466 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 21172
I20260810 06:34:33.658072 21608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.655717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:42183 (local address 127.0.0.1:33894)
0810 06:34:33.657848 (+ 2131us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:33.657958 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:42183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1974}
W20260810 06:34:33.658460 20806 catalog_manager.cc:4584] TS f21f91ba7ace4695a2f2784286fc4201 (127.21.195.193:42183): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 60529d5dece14496aac1f7f32fbe798d: Network error: Client connection negotiation failed: client connection to 127.21.195.193:42183: connect: Connection refused (error 111)
I20260810 06:34:33.669121 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 21390
I20260810 06:34:33.681952 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 20782
2026-08-10T06:34:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2593 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T06:34:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:33Z Disabled control of system clock
I20260810 06:34:33.724020 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35209
--webserver_interface=127.21.195.254
--webserver_port=0
--builtin_ntp_servers=127.21.195.212:42967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:35209
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:34:33.866163 21667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:33.866513 21667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:33.866554 21667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:33.871168 21667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:33.871261 21667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:33.871275 21667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:33.871292 21667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:33.871306 21667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:33.876665 21667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:35209
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:35209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:33.878028 21667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:33.879562 21667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:33.889241 21682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:33.889400 21684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:33.889248 21676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:33.889662 21667 server_base.cc:1034] running on GCE node
I20260810 06:34:33.890350 21667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:33.891697 21667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:33.892884 21667 hybrid_clock.cc:648] HybridClock initialized: now 1786343673892861 us; error 39 us; skew 500 ppm
I20260810 06:34:33.895201 21667 webserver.cc:460] Webserver started at http://127.21.195.254:38017/ using document root <none> and password file <none>
I20260810 06:34:33.895869 21667 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:33.895954 21667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:33.896175 21667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:33.898617 21667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "300f1a515ef7455c8fd3346a65e1addd"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "89740951586bca610d8167df5e3c5e91"
server_key_iv: "a0d1a2c68f3e83e7cbb4bf97a7154ccc"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.899281 21667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "300f1a515ef7455c8fd3346a65e1addd"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "89740951586bca610d8167df5e3c5e91"
server_key_iv: "a0d1a2c68f3e83e7cbb4bf97a7154ccc"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.903628 21667 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:34:33.906680 21693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:33.908142 21667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260810 06:34:33.908303 21667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "300f1a515ef7455c8fd3346a65e1addd"
format_stamp: "Formatted at 2026-08-10 06:34:33 on dist-test-slave-7lbf"
server_key: "89740951586bca610d8167df5e3c5e91"
server_key_iv: "a0d1a2c68f3e83e7cbb4bf97a7154ccc"
server_key_version: "encryptionkey@0"
I20260810 06:34:33.908435 21667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:33.921684 21667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:33.922549 21667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:33.922756 21667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:33.930788 21667 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:35209
I20260810 06:34:33.930825 21772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:35209 every 8 connection(s)
I20260810 06:34:33.931967 21667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:33.935352 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 21667
I20260810 06:34:33.935477 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:33.935709 21773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:33.935779 22287 external_mini_cluster.cc:1428] Setting key a35e237b7241e04b27ab4df5741674bb
I20260810 06:34:33.943733 21773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd: Bootstrap starting.
I20260810 06:34:33.945966 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:33.937312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59760 (local address 127.21.195.254:35209)
0810 06:34:33.938033 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:33.938052 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:33.938093 (+ 41us) server_negotiation.cc:407] Connection header received
0810 06:34:33.938858 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:33.938879 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:33.939351 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:33.939675 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:33.940069 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.941078 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.942366 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:33.942872 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:33.942993 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:33.943994 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:33.944000 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:33.944015 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:33.944449 (+ 434us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:33.944512 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:33.944533 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:33.944611 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:33.944780 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 06:34:33.945079 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":186,"threads_started":1}
I20260810 06:34:33.946450 21773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:33.947348 21773 log.cc:824] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:33.949575 21773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd: No bootstrap required, opened a new log
I20260810 06:34:33.953282 21773 raft_consensus.cc:348] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300f1a515ef7455c8fd3346a65e1addd" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35209 } }
I20260810 06:34:33.953655 21773 raft_consensus.cc:374] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:33.953727 21773 raft_consensus.cc:729] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 300f1a515ef7455c8fd3346a65e1addd, State: Initialized, Role: FOLLOWER
I20260810 06:34:33.954193 21773 consensus_queue.cc:260] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300f1a515ef7455c8fd3346a65e1addd" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35209 } }
I20260810 06:34:33.954334 21773 raft_consensus.cc:388] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:33.954403 21773 raft_consensus.cc:482] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:33.954512 21773 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:33.955533 21773 raft_consensus.cc:504] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300f1a515ef7455c8fd3346a65e1addd" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35209 } }
I20260810 06:34:33.955914 21773 leader_election.cc:302] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 300f1a515ef7455c8fd3346a65e1addd; no voters:
I20260810 06:34:33.956249 21773 leader_election.cc:288] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:33.956372 21782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:33.956605 21782 raft_consensus.cc:686] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [term 1 LEADER]: Becoming Leader. State: Replica: 300f1a515ef7455c8fd3346a65e1addd, State: Running, Role: LEADER
I20260810 06:34:33.956984 21782 consensus_queue.cc:237] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300f1a515ef7455c8fd3346a65e1addd" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35209 } }
I20260810 06:34:33.957643 21773 sys_catalog.cc:564] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:33.958817 21785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 300f1a515ef7455c8fd3346a65e1addd. Latest consensus state: current_term: 1 leader_uuid: "300f1a515ef7455c8fd3346a65e1addd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300f1a515ef7455c8fd3346a65e1addd" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35209 } } }
I20260810 06:34:33.958961 21785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:33.959225 21783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "300f1a515ef7455c8fd3346a65e1addd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "300f1a515ef7455c8fd3346a65e1addd" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 35209 } } }
I20260810 06:34:33.959327 21783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd [sys.catalog]: This master's current role is: LEADER
W20260810 06:34:33.962814 21806 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:34:33.962913 21806 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:34:33.962985 21796 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:33.963954 21796 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:33.970304 21796 catalog_manager.cc:1347] Generated new cluster ID: efd8ee343caf46c5b36695ad34ca1c7c
I20260810 06:34:33.970402 21796 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:33.978899 21796 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:33.980334 21796 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:33.988134 21796 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd: Generated new TSK 0
I20260810 06:34:33.989157 21796 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:33.992506 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.193:0
--local_ip_for_outbound_sockets=127.21.195.193
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35209
--builtin_ntp_servers=127.21.195.212:42967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 06:34:34.118382 21813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:34.118713 21813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:34.118754 21813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:34.123051 21813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:34.123128 21813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:34.123189 21813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.193
I20260810 06:34:34.128342 21813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.195.193
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.193
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:34.129700 21813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:34.131335 21813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:34.141933 21827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:34.141933 21825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:34.141933 21823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:34.142199 21813 server_base.cc:1034] running on GCE node
I20260810 06:34:34.142802 21813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:34.143549 21813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:34.144717 21813 hybrid_clock.cc:648] HybridClock initialized: now 1786343674144690 us; error 41 us; skew 500 ppm
I20260810 06:34:34.146910 21813 webserver.cc:460] Webserver started at http://127.21.195.193:33829/ using document root <none> and password file <none>
I20260810 06:34:34.147567 21813 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:34.147640 21813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:34.147866 21813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:34.150264 21813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/data/instance:
uuid: "703297cc6ae640889c4e444bc3d47f49"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "0ca41e3fd8b64d9b5df55eabf57d0d37"
server_key_iv: "9cc94dc3fcdd70884db46a0cf0d5c180"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.150921 21813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance:
uuid: "703297cc6ae640889c4e444bc3d47f49"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "0ca41e3fd8b64d9b5df55eabf57d0d37"
server_key_iv: "9cc94dc3fcdd70884db46a0cf0d5c180"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.155177 21813 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:34.157959 21836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.159480 21813 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 06:34:34.159631 21813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/wal
uuid: "703297cc6ae640889c4e444bc3d47f49"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "0ca41e3fd8b64d9b5df55eabf57d0d37"
server_key_iv: "9cc94dc3fcdd70884db46a0cf0d5c180"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.159754 21813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:34.176697 21813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:34.177557 21813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:34.177759 21813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:34.178462 21813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:34.179584 21813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:34.179636 21813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.179682 21813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:34.179711 21813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.188519 21813 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.193:37943
I20260810 06:34:34.188548 22029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.193:37943 every 8 connection(s)
I20260810 06:34:34.189661 21813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/data/info.pb
I20260810 06:34:34.190876 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 21813
I20260810 06:34:34.191013 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-0/wal/instance
I20260810 06:34:34.191337 22287 external_mini_cluster.cc:1428] Setting key 268e3415f29c67b177df7481df57271d
I20260810 06:34:34.193394 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.194:0
--local_ip_for_outbound_sockets=127.21.195.194
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35209
--builtin_ntp_servers=127.21.195.212:42967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:34:34.200227 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.191831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:50421 (local address 127.21.195.254:35209)
0810 06:34:34.191992 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.191996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.193639 (+ 1643us) server_negotiation.cc:407] Connection header received
0810 06:34:34.195010 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.195013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.195080 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.195161 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:34.196223 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.196766 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.198075 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.198314 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.198413 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.199671 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:34.199674 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:34.199676 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:34.199692 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:34.199715 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:34.199723 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:34.199785 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.199954 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.200057 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:34:34.201227 22032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.192413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35209 (local address 127.21.195.193:50421)
0810 06:34:34.193295 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.193357 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:34.194771 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:34.195371 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:34.195380 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:34.195491 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:34.196059 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.196075 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.196912 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.196916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.197937 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.197951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.198497 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.198502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.198667 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.199353 (+ 686us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:34.199354 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:34.199413 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:34.199495 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:34.199798 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:34.199809 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:34.199816 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:34:34.199943 (+ 127us) client_negotiation.cc:240] Negotiation successful
0810 06:34:34.200282 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":157,"threads_started":1}
I20260810 06:34:34.202821 22030 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35209
I20260810 06:34:34.203135 22030 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:34.203769 22030 heartbeater.cc:511] Master 127.21.195.254:35209 requested a full tablet report, sending...
I20260810 06:34:34.205636 21724 ts_manager.cc:194] Registered new tserver with Master: 703297cc6ae640889c4e444bc3d47f49 (127.21.195.193:37943)
I20260810 06:34:34.206998 21724 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.193:50421
W20260810 06:34:34.317395 22034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:34.317770 22034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:34.317834 22034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:34.322074 22034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:34.322147 22034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:34.322232 22034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.194
I20260810 06:34:34.327349 22034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.195.194
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.194
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:34.328636 22034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:34.330664 22034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:34.341807 22044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:34.341799 22046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:34.341804 22041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:34.342149 22034 server_base.cc:1034] running on GCE node
I20260810 06:34:34.342612 22034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:34.343355 22034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:34.344524 22034 hybrid_clock.cc:648] HybridClock initialized: now 1786343674344509 us; error 28 us; skew 500 ppm
I20260810 06:34:34.346675 22034 webserver.cc:460] Webserver started at http://127.21.195.194:38589/ using document root <none> and password file <none>
I20260810 06:34:34.347350 22034 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:34.347424 22034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:34.347646 22034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:34.349951 22034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/data/instance:
uuid: "f75b2a85858546a79501bf84fcf12432"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "209294ef5796ae0e8178629dffb89a78"
server_key_iv: "e8bab60219d52a6cd9c96746e5c3f3ac"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.350589 22034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance:
uuid: "f75b2a85858546a79501bf84fcf12432"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "209294ef5796ae0e8178629dffb89a78"
server_key_iv: "e8bab60219d52a6cd9c96746e5c3f3ac"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.354622 22034 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:34:34.357323 22055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.358815 22034 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 06:34:34.358938 22034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/wal
uuid: "f75b2a85858546a79501bf84fcf12432"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "209294ef5796ae0e8178629dffb89a78"
server_key_iv: "e8bab60219d52a6cd9c96746e5c3f3ac"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.359071 22034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:34.368932 22034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:34.369755 22034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:34.369956 22034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:34.370611 22034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:34.371688 22034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:34.371739 22034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.371781 22034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:34.371801 22034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.381112 22034 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.194:46379
I20260810 06:34:34.381160 22245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.194:46379 every 8 connection(s)
I20260810 06:34:34.382198 22034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/data/info.pb
I20260810 06:34:34.391474 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22034
I20260810 06:34:34.391619 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/wal/instance
I20260810 06:34:34.391969 22287 external_mini_cluster.cc:1428] Setting key 0ab8bec57dbc8424ab5248b7d592b052
I20260810 06:34:34.392379 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.384242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.194:57545 (local address 127.21.195.254:35209)
0810 06:34:34.384397 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.384402 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.385675 (+ 1273us) server_negotiation.cc:407] Connection header received
0810 06:34:34.387200 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.387203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.387263 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.387346 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:34.388358 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.388903 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.390225 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.390472 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.390585 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.391853 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:34.391856 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:34.391859 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:34.391874 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:34.391897 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:34.391907 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:34.391968 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.392172 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.392242 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 06:34:34.393679 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.384713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35209 (local address 127.21.195.194:57545)
0810 06:34:34.385469 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.385543 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:34.386974 (+ 1431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:34.387542 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:34.387550 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:34.387648 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:34.388204 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.388219 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.389008 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.389011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.390060 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.390073 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.390637 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.390640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.390797 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.391491 (+ 694us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:34.391494 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:34.391562 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:34.391669 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:34.391990 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:34.392001 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:34.392009 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 06:34:34.392161 (+ 152us) client_negotiation.cc:240] Negotiation successful
0810 06:34:34.392541 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":128,"threads_started":1}
I20260810 06:34:34.394407 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.195.195:0
--local_ip_for_outbound_sockets=127.21.195.195
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35209
--builtin_ntp_servers=127.21.195.212:42967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 06:34:34.395146 22246 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35209
I20260810 06:34:34.395464 22246 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:34.396159 22246 heartbeater.cc:511] Master 127.21.195.254:35209 requested a full tablet report, sending...
I20260810 06:34:34.397552 21724 ts_manager.cc:194] Registered new tserver with Master: f75b2a85858546a79501bf84fcf12432 (127.21.195.194:46379)
I20260810 06:34:34.398200 21724 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.194:57545
W20260810 06:34:34.519146 22251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:34.519454 22251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:34.519493 22251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:34.523792 22251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:34.523873 22251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:34.523936 22251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.195.195
I20260810 06:34:34.529053 22251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:42967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.195.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.195.195
--webserver_port=0
--tserver_master_addrs=127.21.195.254:35209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.195.195
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:34.530351 22251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:34.532012 22251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:34.542605 22263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:34.542627 22262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:34.542629 22267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:34.542943 22251 server_base.cc:1034] running on GCE node
I20260810 06:34:34.543430 22251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:34.544196 22251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:34.545377 22251 hybrid_clock.cc:648] HybridClock initialized: now 1786343674545356 us; error 35 us; skew 500 ppm
I20260810 06:34:34.547499 22251 webserver.cc:460] Webserver started at http://127.21.195.195:34873/ using document root <none> and password file <none>
I20260810 06:34:34.548164 22251 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:34.548241 22251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:34.548477 22251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:34.550876 22251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/data/instance:
uuid: "c79e4f6434bd48649623ef2d57177a31"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "d8a8a92ee17eb290e8d01bab14d31c22"
server_key_iv: "2c8d4895274ab83a031f9a594ff5f05a"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.551517 22251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance:
uuid: "c79e4f6434bd48649623ef2d57177a31"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "d8a8a92ee17eb290e8d01bab14d31c22"
server_key_iv: "2c8d4895274ab83a031f9a594ff5f05a"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.555786 22251 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:34:34.558723 22280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.560195 22251 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:34.560343 22251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/wal
uuid: "c79e4f6434bd48649623ef2d57177a31"
format_stamp: "Formatted at 2026-08-10 06:34:34 on dist-test-slave-7lbf"
server_key: "d8a8a92ee17eb290e8d01bab14d31c22"
server_key_iv: "2c8d4895274ab83a031f9a594ff5f05a"
server_key_version: "encryptionkey@0"
I20260810 06:34:34.560470 22251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:34.577661 22251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:34.578523 22251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:34.578735 22251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:34.579429 22251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 06:34:34.580549 22251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 06:34:34.580605 22251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.580664 22251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 06:34:34.580689 22251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:34.589780 22251 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.195:45183
I20260810 06:34:34.589803 22473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.195:45183 every 8 connection(s)
I20260810 06:34:34.590852 22251 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/data/info.pb
I20260810 06:34:34.592965 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22251
I20260810 06:34:34.593088 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/wal/instance
I20260810 06:34:34.593410 22287 external_mini_cluster.cc:1428] Setting key f2828304cb5498bac2fa31813ef93608
I20260810 06:34:34.601444 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.592862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.195:51631 (local address 127.21.195.254:35209)
0810 06:34:34.592997 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.593001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.594700 (+ 1699us) server_negotiation.cc:407] Connection header received
0810 06:34:34.596512 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.596516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.596575 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.596653 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:34.597693 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.598230 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.599434 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.599656 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.599750 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.600936 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:34.600939 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:34.600941 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:34.600955 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:34.600977 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:34.600985 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:34.601044 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.601206 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.601280 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:34:34.602433 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.593573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:35209 (local address 127.21.195.195:51631)
0810 06:34:34.594528 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.594594 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:34.596276 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:34.596871 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:34.596879 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:34.596977 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:34:34.597541 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.597559 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.598359 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.598363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.599301 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.599313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.599812 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.599817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.599994 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.600636 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 06:34:34.600638 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:34:34.600690 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 06:34:34.600764 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:34:34.601054 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:34:34.601065 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:34:34.601072 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 06:34:34.601194 (+ 122us) client_negotiation.cc:240] Negotiation successful
0810 06:34:34.601563 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":182,"threads_started":1}
I20260810 06:34:34.603761 22475 heartbeater.cc:347] Connected to a master server at 127.21.195.254:35209
I20260810 06:34:34.604053 22475 heartbeater.cc:464] Registering TS with master...
I20260810 06:34:34.604635 22475 heartbeater.cc:511] Master 127.21.195.254:35209 requested a full tablet report, sending...
I20260810 06:34:34.605886 21724 ts_manager.cc:194] Registered new tserver with Master: c79e4f6434bd48649623ef2d57177a31 (127.21.195.195:45183)
I20260810 06:34:34.606513 21724 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.195.195:51631
I20260810 06:34:34.608083 22287 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 06:34:34.614028 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.610377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59770 (local address 127.21.195.254:35209)
0810 06:34:34.610530 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.610534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.610723 (+ 189us) server_negotiation.cc:407] Connection header received
0810 06:34:34.610853 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.610855 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.610896 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.610992 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:34.611219 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.611722 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.612568 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.612788 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.612862 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.613631 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:34.613635 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:34.613637 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:34.613650 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:34.613671 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:34.613679 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:34.613735 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.613831 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.613884 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 06:34:34.617214 21723 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59770:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 06:34:34.620486 21723 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 06:34:34.636488 22503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.630470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54344 (local address 127.21.195.193:37943)
0810 06:34:34.631099 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.631112 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.631292 (+ 180us) server_negotiation.cc:407] Connection header received
0810 06:34:34.631380 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.631386 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.631614 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.631769 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:34.632358 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.633612 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.634971 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.635823 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.635955 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.636155 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.636252 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.636341 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":166,"threads_started":1}
I20260810 06:34:34.636526 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.630160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:37943 (local address 127.0.0.1:54344)
0810 06:34:34.631105 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.631117 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:34.631202 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:34.631953 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:34.631959 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:34.631994 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:34.632218 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.632223 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.633717 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.633721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.634846 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.634854 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.635931 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.635935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.636052 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.636096 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 06:34:34.636222 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 06:34:34.636361 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"mutex_wait_us":68,"spinlock_wait_cycles":4736,"thread_start_us":92,"threads_started":1}
I20260810 06:34:34.637344 22497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.629782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45183 (local address 127.0.0.1:57912)
0810 06:34:34.631053 (+ 1271us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.631068 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:34.631230 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:34.631951 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:34.631956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:34.631985 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:34.632197 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.632203 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.633262 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.633265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.634809 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.634821 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.636920 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.636924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.637015 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.637038 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 06:34:34.637116 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 06:34:34.637190 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"mutex_wait_us":71,"spinlock_wait_cycles":10880,"thread_start_us":84,"threads_started":1}
I20260810 06:34:34.637658 22498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.629836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46379 (local address 127.0.0.1:34072)
0810 06:34:34.630697 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.630759 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:34.630894 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:34.631953 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:34.631959 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:34.632000 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:34.632215 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.632223 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.634958 (+ 2735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.634961 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.635680 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.635687 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.636985 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.636988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.637063 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.637081 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 06:34:34.637138 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 06:34:34.637198 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"mutex_wait_us":32,"spinlock_wait_cycles":11520,"thread_start_us":114,"threads_started":1}
I20260810 06:34:34.637703 22501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.629892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57912 (local address 127.21.195.195:45183)
0810 06:34:34.630879 (+ 987us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.630893 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.631155 (+ 262us) server_negotiation.cc:407] Connection header received
0810 06:34:34.631385 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.631391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.631627 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.631777 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:34.632319 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.633123 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.634948 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.635823 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.635953 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.636155 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.637171 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.637287 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":877,"thread_start_us":178,"threads_started":1}
I20260810 06:34:34.638595 22505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.630750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34072 (local address 127.21.195.194:46379)
0810 06:34:34.631306 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.631318 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.631336 (+ 18us) server_negotiation.cc:407] Connection header received
0810 06:34:34.631396 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.631401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.631614 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.631769 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:34.632358 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.633599 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.635807 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.636617 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.636742 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.636931 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.637285 (+ 354us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.637389 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":99,"threads_started":1}
I20260810 06:34:34.640269 21922 tablet_service.cc:1467] Processing CreateTablet for tablet e2cb5918e966401094834908ce678a00 (DEFAULT_TABLE table=test-table [id=b8665e096e8d44258a58a64085084add]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:34.640712 22371 tablet_service.cc:1467] Processing CreateTablet for tablet e2cb5918e966401094834908ce678a00 (DEFAULT_TABLE table=test-table [id=b8665e096e8d44258a58a64085084add]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:34.641185 22140 tablet_service.cc:1467] Processing CreateTablet for tablet e2cb5918e966401094834908ce678a00 (DEFAULT_TABLE table=test-table [id=b8665e096e8d44258a58a64085084add]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 06:34:34.641640 21922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2cb5918e966401094834908ce678a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:34.641906 22371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2cb5918e966401094834908ce678a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:34.642230 22140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2cb5918e966401094834908ce678a00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:34.649715 22508 tablet_bootstrap.cc:492] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: Bootstrap starting.
I20260810 06:34:34.650365 22509 tablet_bootstrap.cc:492] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49: Bootstrap starting.
I20260810 06:34:34.652074 22508 tablet_bootstrap.cc:654] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:34.652323 22509 tablet_bootstrap.cc:654] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:34.652612 22510 tablet_bootstrap.cc:492] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Bootstrap starting.
I20260810 06:34:34.653064 22508 log.cc:824] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:34.653091 22509 log.cc:824] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:34.655320 22510 tablet_bootstrap.cc:654] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:34.655591 22508 tablet_bootstrap.cc:492] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: No bootstrap required, opened a new log
I20260810 06:34:34.655740 22509 tablet_bootstrap.cc:492] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49: No bootstrap required, opened a new log
I20260810 06:34:34.655834 22508 ts_tablet_manager.cc:1397] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260810 06:34:34.655941 22509 ts_tablet_manager.cc:1397] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260810 06:34:34.656265 22510 log.cc:824] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:34.658814 22510 tablet_bootstrap.cc:492] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: No bootstrap required, opened a new log
I20260810 06:34:34.659063 22510 ts_tablet_manager.cc:1397] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260810 06:34:34.659971 22509 raft_consensus.cc:348] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.660229 22509 raft_consensus.cc:374] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:34.660283 22509 raft_consensus.cc:729] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 703297cc6ae640889c4e444bc3d47f49, State: Initialized, Role: FOLLOWER
I20260810 06:34:34.660372 22508 raft_consensus.cc:348] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.660688 22508 raft_consensus.cc:374] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:34.660748 22508 raft_consensus.cc:729] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f75b2a85858546a79501bf84fcf12432, State: Initialized, Role: FOLLOWER
I20260810 06:34:34.660882 22509 consensus_queue.cc:260] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.661242 22508 consensus_queue.cc:260] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.662051 22509 ts_tablet_manager.cc:1428] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260810 06:34:34.662485 22030 heartbeater.cc:503] Master 127.21.195.254:35209 was elected leader, sending a full tablet report...
I20260810 06:34:34.663671 22508 ts_tablet_manager.cc:1428] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260810 06:34:34.663738 22510 raft_consensus.cc:348] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.664039 22510 raft_consensus.cc:374] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:34.664085 22246 heartbeater.cc:503] Master 127.21.195.254:35209 was elected leader, sending a full tablet report...
I20260810 06:34:34.664103 22510 raft_consensus.cc:729] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c79e4f6434bd48649623ef2d57177a31, State: Initialized, Role: FOLLOWER
I20260810 06:34:34.664624 22510 consensus_queue.cc:260] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.665333 22475 heartbeater.cc:503] Master 127.21.195.254:35209 was elected leader, sending a full tablet report...
I20260810 06:34:34.665850 22510 ts_tablet_manager.cc:1428] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
W20260810 06:34:34.691017 22031 tablet.cc:2369] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:34:34.777783 22515 raft_consensus.cc:482] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 06:34:34.778048 22515 raft_consensus.cc:504] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.779395 22515 leader_election.cc:288] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c79e4f6434bd48649623ef2d57177a31 (127.21.195.195:45183), f75b2a85858546a79501bf84fcf12432 (127.21.195.194:46379)
I20260810 06:34:34.785061 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.779755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.194:46379 (local address 127.21.195.193:53729)
0810 06:34:34.780145 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.780156 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:34.780276 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:34.780575 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:34.780578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:34.780607 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:34.780821 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.780830 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.781924 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.781929 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.783547 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.783561 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.784507 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.784511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.784627 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.784697 (+ 70us) client_negotiation.cc:769] Sending connection context
0810 06:34:34.784776 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 06:34:34.784879 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":182,"spinlock_wait_cycles":12032,"thread_start_us":164,"threads_started":1}
I20260810 06:34:34.785037 22505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.779970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:53729 (local address 127.21.195.194:46379)
0810 06:34:34.780119 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.780122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.780236 (+ 114us) server_negotiation.cc:407] Connection header received
0810 06:34:34.780388 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.780392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.780453 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.780549 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:34.780974 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.781780 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.783716 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.784363 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.784496 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.784555 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.784818 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.784898 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:34:34.785185 22501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.779818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.195.193:48559 (local address 127.21.195.195:45183)
0810 06:34:34.779965 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.779970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.780231 (+ 261us) server_negotiation.cc:407] Connection header received
0810 06:34:34.780389 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.780392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.780486 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.780562 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 06:34:34.780946 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.781781 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.783716 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.784355 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.784497 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.784555 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.784937 (+ 382us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.785035 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 06:34:34.785622 22523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.779700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.195:45183 (local address 127.21.195.193:48559)
0810 06:34:34.780102 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.780118 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:34:34.780276 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:34:34.780582 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:34:34.780584 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:34:34.780607 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 06:34:34.780830 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.780836 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.781925 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.781929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.783547 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:34:34.783561 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.784638 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.784642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:34:34.784774 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.784802 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 06:34:34.785343 (+ 541us) client_negotiation.cc:240] Negotiation successful
0810 06:34:34.785441 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":189,"spinlock_wait_cycles":31744,"thread_start_us":106,"threads_started":1}
I20260810 06:34:34.786275 22171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2cb5918e966401094834908ce678a00" candidate_uuid: "703297cc6ae640889c4e444bc3d47f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b2a85858546a79501bf84fcf12432" is_pre_election: true
I20260810 06:34:34.786487 22400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2cb5918e966401094834908ce678a00" candidate_uuid: "703297cc6ae640889c4e444bc3d47f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c79e4f6434bd48649623ef2d57177a31" is_pre_election: true
I20260810 06:34:34.786618 22171 raft_consensus.cc:2454] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 703297cc6ae640889c4e444bc3d47f49 in term 0.
I20260810 06:34:34.786998 22400 raft_consensus.cc:2454] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 703297cc6ae640889c4e444bc3d47f49 in term 0.
I20260810 06:34:34.787209 21841 leader_election.cc:302] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 703297cc6ae640889c4e444bc3d47f49, f75b2a85858546a79501bf84fcf12432; no voters:
I20260810 06:34:34.787555 22515 raft_consensus.cc:2781] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 06:34:34.787660 22515 raft_consensus.cc:482] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 06:34:34.787711 22515 raft_consensus.cc:3037] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:34.788852 22515 raft_consensus.cc:504] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.789237 22515 leader_election.cc:288] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [CANDIDATE]: Term 1 election: Requested vote from peers c79e4f6434bd48649623ef2d57177a31 (127.21.195.195:45183), f75b2a85858546a79501bf84fcf12432 (127.21.195.194:46379)
I20260810 06:34:34.789692 22171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2cb5918e966401094834908ce678a00" candidate_uuid: "703297cc6ae640889c4e444bc3d47f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f75b2a85858546a79501bf84fcf12432"
I20260810 06:34:34.789820 22171 raft_consensus.cc:3037] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:34.789803 22400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2cb5918e966401094834908ce678a00" candidate_uuid: "703297cc6ae640889c4e444bc3d47f49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c79e4f6434bd48649623ef2d57177a31"
I20260810 06:34:34.789997 22400 raft_consensus.cc:3037] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:34.791276 22400 raft_consensus.cc:2454] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 703297cc6ae640889c4e444bc3d47f49 in term 1.
I20260810 06:34:34.791299 22171 raft_consensus.cc:2454] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 703297cc6ae640889c4e444bc3d47f49 in term 1.
I20260810 06:34:34.791689 21841 leader_election.cc:302] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 703297cc6ae640889c4e444bc3d47f49, f75b2a85858546a79501bf84fcf12432; no voters:
I20260810 06:34:34.791891 22515 raft_consensus.cc:2781] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:34.792155 22515 raft_consensus.cc:686] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [term 1 LEADER]: Becoming Leader. State: Replica: 703297cc6ae640889c4e444bc3d47f49, State: Running, Role: LEADER
I20260810 06:34:34.792558 22515 consensus_queue.cc:237] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } }
I20260810 06:34:34.795945 21724 catalog_manager.cc:5495] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 703297cc6ae640889c4e444bc3d47f49 (127.21.195.193). New cstate: current_term: 1 leader_uuid: "703297cc6ae640889c4e444bc3d47f49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "703297cc6ae640889c4e444bc3d47f49" member_type: VOTER last_known_addr { host: "127.21.195.193" port: 37943 } health_report { overall_health: HEALTHY } } }
I20260810 06:34:34.830783 22503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.827311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54346 (local address 127.21.195.193:37943)
0810 06:34:34.827464 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:34.827468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:34.827482 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:34:34.827603 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:34.827606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:34.827668 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:34.827765 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:34:34.827979 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.828503 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.829349 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:34.829602 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:34.829684 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:34.829946 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:34:34.830431 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:34:34.830543 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:34.830570 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 06:34:34.830631 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:34:34.837826 22400 raft_consensus.cc:1261] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 1 FOLLOWER]: Refusing update from remote peer 703297cc6ae640889c4e444bc3d47f49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:34.837850 22171 raft_consensus.cc:1261] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 1 FOLLOWER]: Refusing update from remote peer 703297cc6ae640889c4e444bc3d47f49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:34:34.838593 22515 consensus_queue.cc:1035] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f75b2a85858546a79501bf84fcf12432" member_type: VOTER last_known_addr { host: "127.21.195.194" port: 46379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:34:34.838819 22527 consensus_queue.cc:1035] T e2cb5918e966401094834908ce678a00 P 703297cc6ae640889c4e444bc3d47f49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c79e4f6434bd48649623ef2d57177a31" member_type: VOTER last_known_addr { host: "127.21.195.195" port: 45183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 06:34:34.841843 22476 tablet.cc:2369] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:34:34.847186 22533 mvcc.cc:205] Tried to move back new op lower bound from 7316863692126203904 to 7316863691953557504. Current Snapshot: MvccSnapshot[applied={T|T < 7316863692126203904}]
I20260810 06:34:34.849009 22534 mvcc.cc:205] Tried to move back new op lower bound from 7316863692126203904 to 7316863691953557504. Current Snapshot: MvccSnapshot[applied={T|T < 7316863692126203904}]
I20260810 06:34:34.857156 21724 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:34.857353 21724 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59770:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 06:34:34.860230 21724 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 300f1a515ef7455c8fd3346a65e1addd: Sending DeleteTablet for 3 replicas of tablet e2cb5918e966401094834908ce678a00
I20260810 06:34:34.861193 22140 tablet_service.cc:1514] Processing DeleteTablet for tablet e2cb5918e966401094834908ce678a00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:34 UTC) from {username='slave'} at 127.0.0.1:34072
I20260810 06:34:34.861197 22371 tablet_service.cc:1514] Processing DeleteTablet for tablet e2cb5918e966401094834908ce678a00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:34 UTC) from {username='slave'} at 127.0.0.1:57912
I20260810 06:34:34.861989 22554 tablet_replica.cc:330] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: stopping tablet replica
I20260810 06:34:34.862118 21922 tablet_service.cc:1514] Processing DeleteTablet for tablet e2cb5918e966401094834908ce678a00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 06:34:34 UTC) from {username='slave'} at 127.0.0.1:54344
I20260810 06:34:34.862386 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 21813
I20260810 06:34:34.865578 22554 raft_consensus.cc:2229] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:34.866053 22554 raft_consensus.cc:2258] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:34.872684 22554 ts_tablet_manager.cc:1905] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:34.875689 22554 ts_tablet_manager.cc:1918] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:34.875932 22554 log.cc:1196] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-1/wal/wals/e2cb5918e966401094834908ce678a00
I20260810 06:34:34.876286 22554 ts_tablet_manager.cc:1939] T e2cb5918e966401094834908ce678a00 P f75b2a85858546a79501bf84fcf12432: Deleting consensus metadata
I20260810 06:34:34.878543 21696 catalog_manager.cc:4841] TS f75b2a85858546a79501bf84fcf12432 (127.21.195.194:46379): tablet e2cb5918e966401094834908ce678a00 (table test-table [id=b8665e096e8d44258a58a64085084add]) successfully deleted
I20260810 06:34:34.879148 22555 tablet_replica.cc:330] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: stopping tablet replica
I20260810 06:34:34.879526 22555 raft_consensus.cc:2229] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 06:34:34.879901 22555 raft_consensus.cc:2258] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 06:34:34.883937 22555 ts_tablet_manager.cc:1905] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 06:34:34.886742 22555 ts_tablet_manager.cc:1918] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 06:34:34.886875 22555 log.cc:1196] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Deleting WAL directory at /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786343407647307-22287-0/minicluster-data/ts-2/wal/wals/e2cb5918e966401094834908ce678a00
I20260810 06:34:34.887307 22555 ts_tablet_manager.cc:1939] T e2cb5918e966401094834908ce678a00 P c79e4f6434bd48649623ef2d57177a31: Deleting consensus metadata
I20260810 06:34:34.888729 21700 catalog_manager.cc:4841] TS c79e4f6434bd48649623ef2d57177a31 (127.21.195.195:45183): tablet e2cb5918e966401094834908ce678a00 (table test-table [id=b8665e096e8d44258a58a64085084add]) successfully deleted
W20260810 06:34:34.890748 21695 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.195.193:37943 (error 108)
I20260810 06:34:34.891016 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22034
I20260810 06:34:34.894371 22498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:34.893965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.193:37943 (local address 127.0.0.1:54362)
0810 06:34:34.894195 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 06:34:34.894273 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.193:37943: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
W20260810 06:34:34.894560 21695 catalog_manager.cc:4584] TS 703297cc6ae640889c4e444bc3d47f49 (127.21.195.193:37943): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e2cb5918e966401094834908ce678a00: Network error: Client connection negotiation failed: client connection to 127.21.195.193:37943: connect: Connection refused (error 111)
I20260810 06:34:34.912242 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22251
I20260810 06:34:34.942278 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 21667
2026-08-10T06:34:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1262 ms)
[----------] 6 tests from EncryptionPolicyTest (11824 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:35 dist-test-slave-7lbf krb5kdc[22561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:35 dist-test-slave-7lbf krb5kdc[22561](info): set up 2 sockets
Aug 10 06:34:35 dist-test-slave-7lbf krb5kdc[22561](info): commencing operation
krb5kdc: starting...
W20260810 06:34:36.126916 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:36 dist-test-slave-7lbf krb5kdc[22561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:36.261090 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43367
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43367
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:36.386029 22582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:36.386344 22582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:36.386387 22582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:36.390738 22582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:36.390830 22582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:36.390851 22582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:36.390866 22582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:36.390880 22582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:36.396644 22582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43367
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:36.398043 22582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:36.399253 22582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:36.409078 22593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:36.409085 22591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:36.409189 22582 server_base.cc:1034] running on GCE node
W20260810 06:34:36.409080 22595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:36.410264 22582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:36.411667 22582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:36.412890 22582 hybrid_clock.cc:648] HybridClock initialized: now 1786343676412869 us; error 40 us; skew 500 ppm
Aug 10 06:34:36 dist-test-slave-7lbf krb5kdc[22561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343676, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:36.416141 22582 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:36.417276 22582 webserver.cc:460] Webserver started at http://127.0.0.1:46577/ using document root <none> and password file <none>
I20260810 06:34:36.417984 22582 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:36.418067 22582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:36.418320 22582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:36.420856 22582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "c9d2f829d87f4e22b5deb61db29db68b"
format_stamp: "Formatted at 2026-08-10 06:34:36 on dist-test-slave-7lbf"
server_key: "a2a48c938d38db82826f7bceea7eaf11"
server_key_iv: "1c5fe20247448b72c3db17abba0e3966"
server_key_version: "encryptionkey@0"
I20260810 06:34:36.421495 22582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "c9d2f829d87f4e22b5deb61db29db68b"
format_stamp: "Formatted at 2026-08-10 06:34:36 on dist-test-slave-7lbf"
server_key: "a2a48c938d38db82826f7bceea7eaf11"
server_key_iv: "1c5fe20247448b72c3db17abba0e3966"
server_key_version: "encryptionkey@0"
I20260810 06:34:36.425879 22582 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:34:36.428658 22608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:36.430172 22582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:36.430325 22582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "c9d2f829d87f4e22b5deb61db29db68b"
format_stamp: "Formatted at 2026-08-10 06:34:36 on dist-test-slave-7lbf"
server_key: "a2a48c938d38db82826f7bceea7eaf11"
server_key_iv: "1c5fe20247448b72c3db17abba0e3966"
server_key_version: "encryptionkey@0"
I20260810 06:34:36.430444 22582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:36.454044 22582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:36.457485 22582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:36.457746 22582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:36.465548 22582 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43367
I20260810 06:34:36.465561 22686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43367 every 8 connection(s)
I20260810 06:34:36.466657 22582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:36.469763 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22582
I20260810 06:34:36.469906 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:36.469887 22687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:36.470204 22287 external_mini_cluster.cc:1428] Setting key 888ea6b9a712f1a8a84551e4c054853b
I20260810 06:34:36.478104 22687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b: Bootstrap starting.
Aug 10 06:34:36 dist-test-slave-7lbf krb5kdc[22561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 06:34:36.480743 22687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:36.481798 22687 log.cc:824] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:36.484434 22687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b: No bootstrap required, opened a new log
I20260810 06:34:36.486697 22691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:36.471836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45889 (local address 127.0.0.1:43367)
0810 06:34:36.472325 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:36.472345 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:36.472395 (+ 50us) server_negotiation.cc:407] Connection header received
0810 06:34:36.473099 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:36.473126 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:36.473659 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:36.474077 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:36.474787 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:36.476384 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:36.477332 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:36.478100 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:36.478277 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:36.480932 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:36.480939 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:36.480960 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:36.481001 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:36.482893 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:36.483455 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:36.483461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:36.483468 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:36.483629 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:36.483982 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:36.483985 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:36.483987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:36.484574 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:36.484791 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:36.485102 (+ 311us) server_negotiation.cc:299] Negotiation successful
0810 06:34:36.485357 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":133,"threads_started":1}
I20260810 06:34:36.488582 22687 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2f829d87f4e22b5deb61db29db68b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43367 } }
I20260810 06:34:36.488873 22687 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:36.488960 22687 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9d2f829d87f4e22b5deb61db29db68b, State: Initialized, Role: FOLLOWER
I20260810 06:34:36.489465 22687 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2f829d87f4e22b5deb61db29db68b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43367 } }
I20260810 06:34:36.489677 22687 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:36.489751 22687 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:36.489857 22687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:36.490204 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:36.490975 22687 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2f829d87f4e22b5deb61db29db68b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43367 } }
I20260810 06:34:36.491345 22687 leader_election.cc:302] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9d2f829d87f4e22b5deb61db29db68b; no voters:
I20260810 06:34:36.491751 22687 leader_election.cc:288] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:36.491834 22700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:36.492054 22700 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [term 1 LEADER]: Becoming Leader. State: Replica: c9d2f829d87f4e22b5deb61db29db68b, State: Running, Role: LEADER
I20260810 06:34:36.492375 22700 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2f829d87f4e22b5deb61db29db68b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43367 } }
I20260810 06:34:36.493247 22687 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:36.494477 22701 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9d2f829d87f4e22b5deb61db29db68b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2f829d87f4e22b5deb61db29db68b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43367 } } }
I20260810 06:34:36.494626 22701 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:36.494870 22702 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9d2f829d87f4e22b5deb61db29db68b. Latest consensus state: current_term: 1 leader_uuid: "c9d2f829d87f4e22b5deb61db29db68b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9d2f829d87f4e22b5deb61db29db68b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43367 } } }
I20260810 06:34:36.494974 22702 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b [sys.catalog]: This master's current role is: LEADER
W20260810 06:34:36.499078 22720 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:34:36.499158 22720 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:34:36.499258 22711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:36.500062 22711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:36.502439 22691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:36.492434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48205 (local address 127.0.0.1:43367)
0810 06:34:36.492547 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:36.492552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:36.492795 (+ 243us) server_negotiation.cc:407] Connection header received
0810 06:34:36.492928 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:36.492931 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:36.492982 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:36.493044 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:36.493950 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:36.494692 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:36.496050 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:36.496374 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:36.496439 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:36.498311 (+ 1872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:36.498315 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:36.498319 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:36.498351 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:36.500073 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:36.500732 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:36.500735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:36.500737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:36.500851 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:36.501275 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:36.501279 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:36.501281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:36.501585 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:36.501738 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:36.502176 (+ 438us) server_negotiation.cc:299] Negotiation successful
0810 06:34:36.502286 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 06:34:36.505863 22711 catalog_manager.cc:1347] Generated new cluster ID: 018137fe675b4fbb8fc7b5b00e9b4ef4
I20260810 06:34:36.505942 22711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:36.513334 22711 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:36.514726 22711 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:36.529696 22711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9d2f829d87f4e22b5deb61db29db68b: Generated new TSK 0
I20260810 06:34:36.530570 22711 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:36.536777 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22582
W20260810 06:34:36.552042 22558 connection.cc:535] client connection to 127.0.0.1:43367 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43367): Connection reset by peer (error 104)
2026-08-10T06:34:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1590 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:36 dist-test-slave-7lbf krb5kdc[22729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:36 dist-test-slave-7lbf krb5kdc[22729](info): set up 2 sockets
Aug 10 06:34:36 dist-test-slave-7lbf krb5kdc[22729](info): commencing operation
krb5kdc: starting...
W20260810 06:34:37.715207 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:37 dist-test-slave-7lbf krb5kdc[22729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:37.848330 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38851
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:37.971037 22751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:37.971369 22751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:37.971415 22751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:37.975708 22751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:37.975796 22751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:37.975817 22751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:37.975847 22751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:37.975876 22751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:37.981873 22751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38851
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:37.983165 22751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:37.984354 22751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:37.993762 22765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:37.993745 22762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:37.993769 22763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:37.994019 22751 server_base.cc:1034] running on GCE node
I20260810 06:34:37.994696 22751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:37.995998 22751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:37.997166 22751 hybrid_clock.cc:648] HybridClock initialized: now 1786343677997146 us; error 36 us; skew 500 ppm
Aug 10 06:34:37 dist-test-slave-7lbf krb5kdc[22729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343677, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:38.000149 22751 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:38.001212 22751 webserver.cc:460] Webserver started at http://127.0.0.1:43511/ using document root <none> and password file <none>
I20260810 06:34:38.001853 22751 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:38.001932 22751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:38.002147 22751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:38.004401 22751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "3102202d4dd64402bbd907de0dffd14b"
format_stamp: "Formatted at 2026-08-10 06:34:37 on dist-test-slave-7lbf"
server_key: "c8e3b3c77a26ff0df13702dfc82a4acc"
server_key_iv: "6eb11f74bc8ff11a7b4d6aa75a841cc9"
server_key_version: "encryptionkey@0"
I20260810 06:34:38.005028 22751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "3102202d4dd64402bbd907de0dffd14b"
format_stamp: "Formatted at 2026-08-10 06:34:37 on dist-test-slave-7lbf"
server_key: "c8e3b3c77a26ff0df13702dfc82a4acc"
server_key_iv: "6eb11f74bc8ff11a7b4d6aa75a841cc9"
server_key_version: "encryptionkey@0"
I20260810 06:34:38.009393 22751 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 06:34:38.012250 22777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:38.013705 22751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:38.013846 22751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "3102202d4dd64402bbd907de0dffd14b"
format_stamp: "Formatted at 2026-08-10 06:34:37 on dist-test-slave-7lbf"
server_key: "c8e3b3c77a26ff0df13702dfc82a4acc"
server_key_iv: "6eb11f74bc8ff11a7b4d6aa75a841cc9"
server_key_version: "encryptionkey@0"
I20260810 06:34:38.013972 22751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:38.030601 22751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:38.033819 22751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:38.034039 22751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:38.041438 22751 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38851
I20260810 06:34:38.041445 22854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38851 every 8 connection(s)
I20260810 06:34:38.042572 22751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:38.045807 22856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:38.046482 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22751
I20260810 06:34:38.046619 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:38.046940 22287 external_mini_cluster.cc:1428] Setting key e2c999ed500cd527db1d28f5e20060e6
I20260810 06:34:38.052866 22856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b: Bootstrap starting.
I20260810 06:34:38.055716 22856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:38.056725 22856 log.cc:824] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:38.057222 22860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:38.048539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35413 (local address 127.0.0.1:38851)
0810 06:34:38.049055 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:38.049071 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:38.049114 (+ 43us) server_negotiation.cc:407] Connection header received
0810 06:34:38.049857 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:38.049880 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:38.050280 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:38.050661 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:38.051094 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:38.052110 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:38.053092 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:38.053655 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:38.053832 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:38.055059 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:38.055065 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:38.055080 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:38.055505 (+ 425us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:38.055575 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:38.055601 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:38.055729 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:38.056000 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 06:34:38.056165 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":148,"threads_started":1}
I20260810 06:34:38.059233 22856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b: No bootstrap required, opened a new log
I20260810 06:34:38.060817 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:38.063369 22856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3102202d4dd64402bbd907de0dffd14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } }
I20260810 06:34:38.063738 22856 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:38.063808 22856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3102202d4dd64402bbd907de0dffd14b, State: Initialized, Role: FOLLOWER
I20260810 06:34:38.064340 22856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3102202d4dd64402bbd907de0dffd14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } }
I20260810 06:34:38.064522 22856 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:38.064602 22856 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:38.064719 22856 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:38.066032 22856 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3102202d4dd64402bbd907de0dffd14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } }
I20260810 06:34:38.066464 22856 leader_election.cc:302] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3102202d4dd64402bbd907de0dffd14b; no voters:
I20260810 06:34:38.066861 22856 leader_election.cc:288] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:38.066960 22869 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:38.067128 22869 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [term 1 LEADER]: Becoming Leader. State: Replica: 3102202d4dd64402bbd907de0dffd14b, State: Running, Role: LEADER
I20260810 06:34:38.067471 22860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:38.062992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33917 (local address 127.0.0.1:38851)
0810 06:34:38.063118 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:38.063122 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:38.063213 (+ 91us) server_negotiation.cc:407] Connection header received
0810 06:34:38.063315 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:38.063318 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:38.063369 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:38.063462 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:38.063683 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:38.064441 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:38.065592 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:38.065879 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:38.065973 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:38.066959 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:38.066964 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:38.066967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:38.066981 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:38.067012 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:38.067026 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:38.067116 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:38.067290 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 06:34:38.067329 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:34:38.067461 22869 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3102202d4dd64402bbd907de0dffd14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } }
I20260810 06:34:38.068354 22856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:38.068799 22869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3102202d4dd64402bbd907de0dffd14b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3102202d4dd64402bbd907de0dffd14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } } }
I20260810 06:34:38.068920 22869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:38.069149 22869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3102202d4dd64402bbd907de0dffd14b. Latest consensus state: current_term: 1 leader_uuid: "3102202d4dd64402bbd907de0dffd14b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3102202d4dd64402bbd907de0dffd14b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } } }
I20260810 06:34:38.069242 22869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:38.069422 22875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:38.072883 22875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:38.079885 22875 catalog_manager.cc:1347] Generated new cluster ID: e03b14a457c3484aad6416e45ff7111b
I20260810 06:34:38.080188 22875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:38.088100 22875 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:38.089465 22875 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:38.098340 22875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3102202d4dd64402bbd907de0dffd14b: Generated new TSK 0
I20260810 06:34:38.099416 22875 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:38.108314 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22751
W20260810 06:34:38.129235 22726 connection.cc:535] client connection to 127.0.0.1:38851 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38851): Connection reset by peer (error 104)
2026-08-10T06:34:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1577 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:38 dist-test-slave-7lbf krb5kdc[22898](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:38 dist-test-slave-7lbf krb5kdc[22898](info): set up 2 sockets
Aug 10 06:34:38 dist-test-slave-7lbf krb5kdc[22898](info): commencing operation
krb5kdc: starting...
W20260810 06:34:39.290377 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:39 dist-test-slave-7lbf krb5kdc[22898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:39.424229 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34977
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:39.545851 22917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:39.546201 22917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:39.546267 22917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:39.550518 22917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:39.550611 22917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:39.550639 22917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:39.550663 22917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:39.550695 22917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:39.556533 22917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34977
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:39.557924 22917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:39.559125 22917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:34:39.568841 22917 server_base.cc:1034] running on GCE node
W20260810 06:34:39.568790 22931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:39.568791 22929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:39.568790 22927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:39.569823 22917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:39.571132 22917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:39.572302 22917 hybrid_clock.cc:648] HybridClock initialized: now 1786343679572258 us; error 59 us; skew 500 ppm
Aug 10 06:34:39 dist-test-slave-7lbf krb5kdc[22898](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343679, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:39.578418 22917 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:39.579569 22917 webserver.cc:460] Webserver started at http://127.0.0.1:37517/ using document root <none> and password file <none>
I20260810 06:34:39.580215 22917 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:39.580287 22917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:39.580516 22917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:39.583009 22917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "0413485e6e704f199a83ac92f5bef7bf"
format_stamp: "Formatted at 2026-08-10 06:34:39 on dist-test-slave-7lbf"
server_key: "942d84827a80204ef53414506a235696"
server_key_iv: "7536fb6e450f3b73171286e5c138fadf"
server_key_version: "encryptionkey@0"
I20260810 06:34:39.583631 22917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "0413485e6e704f199a83ac92f5bef7bf"
format_stamp: "Formatted at 2026-08-10 06:34:39 on dist-test-slave-7lbf"
server_key: "942d84827a80204ef53414506a235696"
server_key_iv: "7536fb6e450f3b73171286e5c138fadf"
server_key_version: "encryptionkey@0"
I20260810 06:34:39.587961 22917 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260810 06:34:39.590782 22946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:39.592203 22917 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:39.592345 22917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "0413485e6e704f199a83ac92f5bef7bf"
format_stamp: "Formatted at 2026-08-10 06:34:39 on dist-test-slave-7lbf"
server_key: "942d84827a80204ef53414506a235696"
server_key_iv: "7536fb6e450f3b73171286e5c138fadf"
server_key_version: "encryptionkey@0"
I20260810 06:34:39.592473 22917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:39.597508 22917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:39.601052 22917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:39.601258 22917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:39.608664 22917 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34977
I20260810 06:34:39.608685 23024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34977 every 8 connection(s)
I20260810 06:34:39.609807 22917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:39.612383 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 22917
I20260810 06:34:39.612556 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:39.612921 22287 external_mini_cluster.cc:1428] Setting key be07aea850aa0a64df1e3e7a40097cbc
I20260810 06:34:39.613627 23025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:39.618530 23030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:39.614477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36873 (local address 127.0.0.1:34977)
0810 06:34:39.614924 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:39.614941 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:39.614981 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:34:39.615660 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:39.615678 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:39.616010 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:39.616326 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:39.617175 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:39.617179 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:39.617194 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:39.617204 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:39.617262 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:39.617281 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:39.617400 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:39.617504 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 06:34:39.617707 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":111,"threads_started":1}
I20260810 06:34:39.620697 23025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf: Bootstrap starting.
I20260810 06:34:39.621744 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:39.623736 23025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:39.624691 23025 log.cc:824] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:39.625952 23030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:39.624202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41191 (local address 127.0.0.1:34977)
0810 06:34:39.624336 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:39.624341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:39.624530 (+ 189us) server_negotiation.cc:407] Connection header received
0810 06:34:39.624626 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:39.624629 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:39.624670 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:39.624757 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:39.625536 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:39.625541 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:39.625544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:39.625557 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:39.625587 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:39.625603 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:39.625692 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:39.625791 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 06:34:39.625825 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:34:39.627322 23025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf: No bootstrap required, opened a new log
I20260810 06:34:39.631474 23025 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0413485e6e704f199a83ac92f5bef7bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34977 } }
I20260810 06:34:39.631757 23025 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:39.631820 23025 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0413485e6e704f199a83ac92f5bef7bf, State: Initialized, Role: FOLLOWER
I20260810 06:34:39.632336 23025 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0413485e6e704f199a83ac92f5bef7bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34977 } }
I20260810 06:34:39.632550 23025 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:39.632623 23025 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:39.632731 23025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:39.634080 23025 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0413485e6e704f199a83ac92f5bef7bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34977 } }
I20260810 06:34:39.634466 23025 leader_election.cc:302] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0413485e6e704f199a83ac92f5bef7bf; no voters:
I20260810 06:34:39.634835 23025 leader_election.cc:288] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:39.634946 23041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:39.635159 23041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [term 1 LEADER]: Becoming Leader. State: Replica: 0413485e6e704f199a83ac92f5bef7bf, State: Running, Role: LEADER
I20260810 06:34:39.635537 23041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0413485e6e704f199a83ac92f5bef7bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34977 } }
I20260810 06:34:39.636174 23025 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:39.637259 23043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0413485e6e704f199a83ac92f5bef7bf. Latest consensus state: current_term: 1 leader_uuid: "0413485e6e704f199a83ac92f5bef7bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0413485e6e704f199a83ac92f5bef7bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34977 } } }
I20260810 06:34:39.637398 23043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:39.637763 23042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0413485e6e704f199a83ac92f5bef7bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0413485e6e704f199a83ac92f5bef7bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34977 } } }
I20260810 06:34:39.637916 23042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:39.637818 23054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:39.641590 23054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:39.647676 23054 catalog_manager.cc:1347] Generated new cluster ID: 4ae3671bdb59439792acca7dc46ffbf0
I20260810 06:34:39.647774 23054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:39.662374 23054 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:39.662744 23054 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:39.667112 23054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0413485e6e704f199a83ac92f5bef7bf: Generated new TSK 0
I20260810 06:34:39.667897 23054 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:39.681243 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 22917
2026-08-10T06:34:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1579 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:39 dist-test-slave-7lbf krb5kdc[23080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:39 dist-test-slave-7lbf krb5kdc[23080](info): set up 2 sockets
Aug 10 06:34:39 dist-test-slave-7lbf krb5kdc[23080](info): commencing operation
krb5kdc: starting...
W20260810 06:34:40.875574 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:40 dist-test-slave-7lbf krb5kdc[23080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:41.008184 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37713
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:41.131870 23103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:41.132225 23103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:41.132292 23103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:41.136528 23103 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:41.136617 23103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:41.136647 23103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:41.136669 23103 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:41.136689 23103 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:41.142450 23103 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:41.143716 23103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:41.144884 23103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:41.154346 23110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:41.154340 23109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:41.154340 23113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:41.154785 23103 server_base.cc:1034] running on GCE node
I20260810 06:34:41.155450 23103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:41.156766 23103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:41.157932 23103 hybrid_clock.cc:648] HybridClock initialized: now 1786343681157909 us; error 36 us; skew 500 ppm
Aug 10 06:34:41 dist-test-slave-7lbf krb5kdc[23080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343681, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:41.160981 23103 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:41.162091 23103 webserver.cc:460] Webserver started at http://127.0.0.1:37203/ using document root <none> and password file <none>
I20260810 06:34:41.162719 23103 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:41.162796 23103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:41.163039 23103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:41.165385 23103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "854894c6c95f4fcb83e0fab0d220fb19"
format_stamp: "Formatted at 2026-08-10 06:34:41 on dist-test-slave-7lbf"
server_key: "7baf8d506ad81fffda6ea017c80471ef"
server_key_iv: "570ff2e331aeb4351359d5a3c9cc8eb7"
server_key_version: "encryptionkey@0"
I20260810 06:34:41.166065 23103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "854894c6c95f4fcb83e0fab0d220fb19"
format_stamp: "Formatted at 2026-08-10 06:34:41 on dist-test-slave-7lbf"
server_key: "7baf8d506ad81fffda6ea017c80471ef"
server_key_iv: "570ff2e331aeb4351359d5a3c9cc8eb7"
server_key_version: "encryptionkey@0"
I20260810 06:34:41.170375 23103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:41.173108 23125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:41.174580 23103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:41.174728 23103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "854894c6c95f4fcb83e0fab0d220fb19"
format_stamp: "Formatted at 2026-08-10 06:34:41 on dist-test-slave-7lbf"
server_key: "7baf8d506ad81fffda6ea017c80471ef"
server_key_iv: "570ff2e331aeb4351359d5a3c9cc8eb7"
server_key_version: "encryptionkey@0"
I20260810 06:34:41.174893 23103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:41.196312 23103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:41.200160 23103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:41.200377 23103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:41.207878 23103 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37713
I20260810 06:34:41.207892 23212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37713 every 8 connection(s)
I20260810 06:34:41.209000 23103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:41.212217 23214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:41.216303 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23103
I20260810 06:34:41.216471 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:41.216789 22287 external_mini_cluster.cc:1428] Setting key 5185a77a40f235d5f0448a3de22e5bc5
I20260810 06:34:41.219304 23214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19: Bootstrap starting.
I20260810 06:34:41.221900 23214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:41.222734 23214 log.cc:824] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:41.224917 23214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19: No bootstrap required, opened a new log
Aug 10 06:34:41 dist-test-slave-7lbf krb5kdc[23080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 06:34:41.228994 23214 raft_consensus.cc:348] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854894c6c95f4fcb83e0fab0d220fb19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37713 } }
I20260810 06:34:41.229278 23214 raft_consensus.cc:374] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:41.229341 23214 raft_consensus.cc:729] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854894c6c95f4fcb83e0fab0d220fb19, State: Initialized, Role: FOLLOWER
I20260810 06:34:41.229866 23214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854894c6c95f4fcb83e0fab0d220fb19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37713 } }
I20260810 06:34:41.230023 23214 raft_consensus.cc:388] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:41.230098 23214 raft_consensus.cc:482] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:41.230209 23214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:41.231348 23214 raft_consensus.cc:504] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854894c6c95f4fcb83e0fab0d220fb19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37713 } }
I20260810 06:34:41.231717 23214 leader_election.cc:302] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 854894c6c95f4fcb83e0fab0d220fb19; no voters:
I20260810 06:34:41.231760 23220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:41.218420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54159 (local address 127.0.0.1:37713)
0810 06:34:41.218980 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:41.218997 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:41.219042 (+ 45us) server_negotiation.cc:407] Connection header received
0810 06:34:41.219790 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:41.219814 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:41.220237 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:41.220597 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:41.221455 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:41.222616 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:41.223541 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:41.224054 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:41.224212 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:41.226810 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:41.226816 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:41.226833 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:41.226865 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:41.228564 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:41.229034 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:41.229039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:41.229045 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:41.229187 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:41.229506 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:41.229509 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:41.229531 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:41.230050 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:41.230266 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:41.230560 (+ 294us) server_negotiation.cc:299] Negotiation successful
0810 06:34:41.230889 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":161,"threads_started":1}
I20260810 06:34:41.232192 23214 leader_election.cc:288] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:41.232290 23223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:41.232515 23223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [term 1 LEADER]: Becoming Leader. State: Replica: 854894c6c95f4fcb83e0fab0d220fb19, State: Running, Role: LEADER
I20260810 06:34:41.232913 23223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854894c6c95f4fcb83e0fab0d220fb19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37713 } }
I20260810 06:34:41.233672 23214 sys_catalog.cc:564] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:41.235215 23226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 854894c6c95f4fcb83e0fab0d220fb19. Latest consensus state: current_term: 1 leader_uuid: "854894c6c95f4fcb83e0fab0d220fb19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854894c6c95f4fcb83e0fab0d220fb19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37713 } } }
I20260810 06:34:41.235354 23226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:41.235611 23225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "854894c6c95f4fcb83e0fab0d220fb19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "854894c6c95f4fcb83e0fab0d220fb19" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37713 } } }
I20260810 06:34:41.235657 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:41.235709 23225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:41.236742 23241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:41.240056 23241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:41.246683 23220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:41.237952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35437 (local address 127.0.0.1:37713)
0810 06:34:41.238080 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:41.238084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:41.238321 (+ 237us) server_negotiation.cc:407] Connection header received
0810 06:34:41.238436 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:41.238439 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:41.238500 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:41.238581 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:41.239467 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:41.240257 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:41.241389 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:41.241808 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:41.241924 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:41.243306 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:41.243310 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:41.243313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:41.243338 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:41.244772 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:41.245290 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:41.245293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:41.245295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:41.245391 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:41.245737 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:41.245740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:41.245742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:41.245978 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:41.246108 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:41.246373 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 06:34:41.246521 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:34:41.247046 23241 catalog_manager.cc:1347] Generated new cluster ID: 4e64e259d4c1437e86eb8681e278774c
I20260810 06:34:41.247117 23241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:41.295640 23241 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:41.296795 23241 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:41.305024 23241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 854894c6c95f4fcb83e0fab0d220fb19: Generated new TSK 0
I20260810 06:34:41.305912 23241 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:41.315296 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23103
2026-08-10T06:34:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1630 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:41 dist-test-slave-7lbf krb5kdc[23264](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:41 dist-test-slave-7lbf krb5kdc[23264](info): set up 2 sockets
Aug 10 06:34:41 dist-test-slave-7lbf krb5kdc[23264](info): commencing operation
krb5kdc: starting...
W20260810 06:34:42.500886 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:42 dist-test-slave-7lbf krb5kdc[23264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:42.634948 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36549
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36549
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:42.761466 23287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:42.761858 23287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:42.761906 23287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:42.766108 23287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:42.766196 23287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:42.766218 23287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:42.766238 23287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:42.766255 23287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:42.772037 23287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:42.773337 23287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:42.774547 23287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:42.784145 23303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:42.784157 23301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:42.784142 23298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:42.784482 23287 server_base.cc:1034] running on GCE node
I20260810 06:34:42.785262 23287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:42.786885 23287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:42.790169 23287 hybrid_clock.cc:648] HybridClock initialized: now 1786343682790132 us; error 54 us; skew 500 ppm
Aug 10 06:34:42 dist-test-slave-7lbf krb5kdc[23264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343682, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:42.793571 23287 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:42.794602 23287 webserver.cc:460] Webserver started at http://127.0.0.1:38177/ using document root <none> and password file <none>
I20260810 06:34:42.795194 23287 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:42.795260 23287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:42.795433 23287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:42.797688 23287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "4b0a30e22b8b4d7a84d23fff4a25447c"
format_stamp: "Formatted at 2026-08-10 06:34:42 on dist-test-slave-7lbf"
server_key: "fec7b291d5736d43c1793607cc87bee6"
server_key_iv: "0811689b8e5edd739b97f7957db2b4e2"
server_key_version: "encryptionkey@0"
I20260810 06:34:42.798290 23287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "4b0a30e22b8b4d7a84d23fff4a25447c"
format_stamp: "Formatted at 2026-08-10 06:34:42 on dist-test-slave-7lbf"
server_key: "fec7b291d5736d43c1793607cc87bee6"
server_key_iv: "0811689b8e5edd739b97f7957db2b4e2"
server_key_version: "encryptionkey@0"
I20260810 06:34:42.802531 23287 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:42.805224 23310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:42.806689 23287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:34:42.806834 23287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "4b0a30e22b8b4d7a84d23fff4a25447c"
format_stamp: "Formatted at 2026-08-10 06:34:42 on dist-test-slave-7lbf"
server_key: "fec7b291d5736d43c1793607cc87bee6"
server_key_iv: "0811689b8e5edd739b97f7957db2b4e2"
server_key_version: "encryptionkey@0"
I20260810 06:34:42.806972 23287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:42.841914 23287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:42.845438 23287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:42.845685 23287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:42.853276 23287 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36549
I20260810 06:34:42.853305 23401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36549 every 8 connection(s)
I20260810 06:34:42.854451 23287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:42.857674 23402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:42.863948 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23287
I20260810 06:34:42.864117 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:42.864138 23402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c: Bootstrap starting.
I20260810 06:34:42.864410 22287 external_mini_cluster.cc:1428] Setting key d4ed98bbff594769eb531c2de6ad94cc
I20260810 06:34:42.867291 23402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:42.868319 23402 log.cc:824] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:42.870886 23402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c: No bootstrap required, opened a new log
I20260810 06:34:42.875573 23407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:42.865963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47963 (local address 127.0.0.1:36549)
0810 06:34:42.866447 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:42.866469 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:42.866519 (+ 50us) server_negotiation.cc:407] Connection header received
0810 06:34:42.867450 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:42.867479 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:42.868018 (+ 539us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:42.868440 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:42.868923 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:42.870341 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:42.871377 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:42.872105 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:42.872274 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:42.873123 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:42.873130 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:42.873151 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:42.873753 (+ 602us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:42.873835 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:42.873884 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:42.874001 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:42.874166 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 06:34:42.874441 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":117,"threads_started":1}
I20260810 06:34:42.875802 23402 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0a30e22b8b4d7a84d23fff4a25447c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36549 } }
I20260810 06:34:42.876104 23402 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:42.876169 23402 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b0a30e22b8b4d7a84d23fff4a25447c, State: Initialized, Role: FOLLOWER
I20260810 06:34:42.876646 23402 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0a30e22b8b4d7a84d23fff4a25447c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36549 } }
I20260810 06:34:42.876788 23402 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:42.876855 23402 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:42.876966 23402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:42.878172 23402 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0a30e22b8b4d7a84d23fff4a25447c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36549 } }
I20260810 06:34:42.878577 23402 leader_election.cc:302] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b0a30e22b8b4d7a84d23fff4a25447c; no voters:
I20260810 06:34:42.878821 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:42.878979 23402 leader_election.cc:288] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:42.879078 23412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:42.879292 23412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [term 1 LEADER]: Becoming Leader. State: Replica: 4b0a30e22b8b4d7a84d23fff4a25447c, State: Running, Role: LEADER
I20260810 06:34:42.879726 23412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0a30e22b8b4d7a84d23fff4a25447c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36549 } }
I20260810 06:34:42.880348 23402 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:42.881158 23414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b0a30e22b8b4d7a84d23fff4a25447c. Latest consensus state: current_term: 1 leader_uuid: "4b0a30e22b8b4d7a84d23fff4a25447c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0a30e22b8b4d7a84d23fff4a25447c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36549 } } }
I20260810 06:34:42.881304 23414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:42.881711 23428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:42.881670 23413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b0a30e22b8b4d7a84d23fff4a25447c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0a30e22b8b4d7a84d23fff4a25447c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36549 } } }
I20260810 06:34:42.881769 23413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:42.885413 23428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:42.887281 23407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:42.882024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54771 (local address 127.0.0.1:36549)
0810 06:34:42.882145 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:42.882150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:42.882725 (+ 575us) server_negotiation.cc:407] Connection header received
0810 06:34:42.882872 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:42.882875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:42.882930 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:42.883011 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:42.883335 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:42.884067 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:42.885200 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:42.885557 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:42.885658 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:42.886722 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:42.886726 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:42.886729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:42.886745 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:42.886780 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:42.886796 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:42.886897 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:42.887049 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 06:34:42.887133 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 06:34:42.892659 23428 catalog_manager.cc:1347] Generated new cluster ID: 9bf4fe013bc0433380514815f60741f9
I20260810 06:34:42.892765 23428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:42.912525 23428 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:42.913671 23428 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:42.919588 23428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b0a30e22b8b4d7a84d23fff4a25447c: Generated new TSK 0
I20260810 06:34:42.920423 23428 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:42.929229 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23287
2026-08-10T06:34:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1619 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:43 dist-test-slave-7lbf krb5kdc[23455](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:43 dist-test-slave-7lbf krb5kdc[23455](info): set up 2 sockets
Aug 10 06:34:43 dist-test-slave-7lbf krb5kdc[23455](info): commencing operation
krb5kdc: starting...
W20260810 06:34:44.117049 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:44 dist-test-slave-7lbf krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:44.246945 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41687
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:44.370633 23478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:44.370975 23478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:44.371038 23478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:44.375463 23478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:44.375561 23478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:44.375590 23478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:44.375612 23478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:44.375635 23478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:44.381572 23478 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:44.382864 23478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:44.384068 23478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:44.393893 23488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:44.393911 23491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:44.393893 23494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:44.394012 23478 server_base.cc:1034] running on GCE node
I20260810 06:34:44.394872 23478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:44.396155 23478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:44.397331 23478 hybrid_clock.cc:648] HybridClock initialized: now 1786343684397309 us; error 37 us; skew 500 ppm
Aug 10 06:34:44 dist-test-slave-7lbf krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343684, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:44.400336 23478 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:44.401362 23478 webserver.cc:460] Webserver started at http://127.0.0.1:40045/ using document root <none> and password file <none>
I20260810 06:34:44.402030 23478 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:44.402119 23478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:44.402365 23478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:44.404739 23478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "c5144078ddda46e0b1a5f15b86d4757a"
format_stamp: "Formatted at 2026-08-10 06:34:44 on dist-test-slave-7lbf"
server_key: "23e96fe37a4c50bad666137cdf2734a4"
server_key_iv: "78509abadde805710270c09f72c584e0"
server_key_version: "encryptionkey@0"
I20260810 06:34:44.405377 23478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "c5144078ddda46e0b1a5f15b86d4757a"
format_stamp: "Formatted at 2026-08-10 06:34:44 on dist-test-slave-7lbf"
server_key: "23e96fe37a4c50bad666137cdf2734a4"
server_key_iv: "78509abadde805710270c09f72c584e0"
server_key_version: "encryptionkey@0"
I20260810 06:34:44.409727 23478 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:34:44.412560 23504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:44.414115 23478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:44.414273 23478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "c5144078ddda46e0b1a5f15b86d4757a"
format_stamp: "Formatted at 2026-08-10 06:34:44 on dist-test-slave-7lbf"
server_key: "23e96fe37a4c50bad666137cdf2734a4"
server_key_iv: "78509abadde805710270c09f72c584e0"
server_key_version: "encryptionkey@0"
I20260810 06:34:44.414394 23478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:44.419538 23478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:44.423172 23478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:44.423375 23478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:44.430828 23478 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41687
I20260810 06:34:44.430840 23577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41687 every 8 connection(s)
I20260810 06:34:44.431896 23478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:44.434522 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23478
I20260810 06:34:44.434665 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:44.434953 22287 external_mini_cluster.cc:1428] Setting key 09c345c950667a90fc4c3956f50d1e8e
I20260810 06:34:44.435209 23579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:44.441007 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:44.436505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57813 (local address 127.0.0.1:41687)
0810 06:34:44.436982 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:44.437002 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:44.437049 (+ 47us) server_negotiation.cc:407] Connection header received
0810 06:34:44.437886 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:44.437914 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:44.438324 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:44.438741 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:44.439447 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:44.439453 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:44.439470 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:44.439481 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:44.439547 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:44.439575 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:44.439731 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:44.439805 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 06:34:44.439984 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":121,"threads_started":1}
I20260810 06:34:44.443307 23579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a: Bootstrap starting.
I20260810 06:34:44.444322 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:44.446313 23579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:44.447255 23579 log.cc:824] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:44.448400 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:44.446772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52703 (local address 127.0.0.1:41687)
0810 06:34:44.446909 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:44.446913 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:44.447083 (+ 170us) server_negotiation.cc:407] Connection header received
0810 06:34:44.447183 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:44.447186 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:44.447226 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:44.447315 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:44.448017 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:44.448021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:44.448023 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:44.448037 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:44.448068 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:44.448079 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:44.448150 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:44.448252 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 06:34:44.448285 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:34:44.449718 23579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a: No bootstrap required, opened a new log
I20260810 06:34:44.453701 23579 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5144078ddda46e0b1a5f15b86d4757a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41687 } }
I20260810 06:34:44.454000 23579 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:44.454066 23579 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5144078ddda46e0b1a5f15b86d4757a, State: Initialized, Role: FOLLOWER
I20260810 06:34:44.454555 23579 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5144078ddda46e0b1a5f15b86d4757a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41687 } }
I20260810 06:34:44.454710 23579 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:44.454761 23579 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:44.454839 23579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:44.455868 23579 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5144078ddda46e0b1a5f15b86d4757a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41687 } }
I20260810 06:34:44.456228 23579 leader_election.cc:302] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5144078ddda46e0b1a5f15b86d4757a; no voters:
I20260810 06:34:44.456565 23579 leader_election.cc:288] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:44.456677 23601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:44.456910 23601 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [term 1 LEADER]: Becoming Leader. State: Replica: c5144078ddda46e0b1a5f15b86d4757a, State: Running, Role: LEADER
I20260810 06:34:44.457269 23601 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5144078ddda46e0b1a5f15b86d4757a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41687 } }
I20260810 06:34:44.457993 23579 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:44.459278 23602 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5144078ddda46e0b1a5f15b86d4757a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5144078ddda46e0b1a5f15b86d4757a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41687 } } }
I20260810 06:34:44.459292 23604 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5144078ddda46e0b1a5f15b86d4757a. Latest consensus state: current_term: 1 leader_uuid: "c5144078ddda46e0b1a5f15b86d4757a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5144078ddda46e0b1a5f15b86d4757a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41687 } } }
I20260810 06:34:44.459441 23602 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:44.459444 23604 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:44.459831 23613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:44.462867 23613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:44.469014 23613 catalog_manager.cc:1347] Generated new cluster ID: 940c53039dc24e1d94166e4818ad66d0
I20260810 06:34:44.469113 23613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:44.489571 23613 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:44.489972 23613 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:44.495462 23613 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5144078ddda46e0b1a5f15b86d4757a: Generated new TSK 0
I20260810 06:34:44.496289 23613 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:44.501278 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23478
2026-08-10T06:34:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1558 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:44 dist-test-slave-7lbf krb5kdc[23629](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:44 dist-test-slave-7lbf krb5kdc[23629](info): set up 2 sockets
Aug 10 06:34:44 dist-test-slave-7lbf krb5kdc[23629](info): commencing operation
krb5kdc: starting...
W20260810 06:34:45.693358 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:45 dist-test-slave-7lbf krb5kdc[23629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:45.827051 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42451
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:45.953948 23654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:45.954299 23654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:45.954375 23654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:45.958662 23654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:45.958781 23654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:45.958815 23654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:45.958842 23654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:45.958869 23654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:45.964828 23654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:45.966193 23654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:45.967572 23654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:45.977067 23666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:45.977133 23654 server_base.cc:1034] running on GCE node
W20260810 06:34:45.977083 23661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:45.977095 23660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:45.978055 23654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:45.979254 23654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:45.980424 23654 hybrid_clock.cc:648] HybridClock initialized: now 1786343685980409 us; error 31 us; skew 500 ppm
Aug 10 06:34:45 dist-test-slave-7lbf krb5kdc[23629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343685, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:45.986835 23654 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:45.987972 23654 webserver.cc:460] Webserver started at http://127.0.0.1:45657/ using document root <none> and password file <none>
I20260810 06:34:45.988647 23654 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:45.988780 23654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:45.989063 23654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:45.991534 23654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "1782f6a5c9f2450aaac83d2238f7dbb3"
format_stamp: "Formatted at 2026-08-10 06:34:45 on dist-test-slave-7lbf"
server_key: "261db3b5af803761f2180d8593c075fb"
server_key_iv: "53b48bd8136e2665fa8b2369ee37b189"
server_key_version: "encryptionkey@0"
I20260810 06:34:45.992165 23654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "1782f6a5c9f2450aaac83d2238f7dbb3"
format_stamp: "Formatted at 2026-08-10 06:34:45 on dist-test-slave-7lbf"
server_key: "261db3b5af803761f2180d8593c075fb"
server_key_iv: "53b48bd8136e2665fa8b2369ee37b189"
server_key_version: "encryptionkey@0"
I20260810 06:34:45.996589 23654 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260810 06:34:45.999565 23676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:46.000984 23654 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 06:34:46.001119 23654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "1782f6a5c9f2450aaac83d2238f7dbb3"
format_stamp: "Formatted at 2026-08-10 06:34:45 on dist-test-slave-7lbf"
server_key: "261db3b5af803761f2180d8593c075fb"
server_key_iv: "53b48bd8136e2665fa8b2369ee37b189"
server_key_version: "encryptionkey@0"
I20260810 06:34:46.001243 23654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:46.017256 23654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:46.020558 23654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:46.020769 23654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:46.028932 23654 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42451
I20260810 06:34:46.028949 23743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42451 every 8 connection(s)
I20260810 06:34:46.030174 23654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:46.033970 23746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:46.035307 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23654
I20260810 06:34:46.035449 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:46.035729 22287 external_mini_cluster.cc:1428] Setting key 0c37999f85aa1d4bd83227afb9ea5fd1
I20260810 06:34:46.040611 23746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3: Bootstrap starting.
I20260810 06:34:46.043098 23746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:46.044000 23746 log.cc:824] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:34:46 dist-test-slave-7lbf krb5kdc[23629](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 06:34:46.046386 23746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3: No bootstrap required, opened a new log
I20260810 06:34:46.050235 23746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1782f6a5c9f2450aaac83d2238f7dbb3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42451 } }
I20260810 06:34:46.050520 23746 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:46.050576 23746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1782f6a5c9f2450aaac83d2238f7dbb3, State: Initialized, Role: FOLLOWER
I20260810 06:34:46.050724 23749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:46.037328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:54797 (local address 127.0.0.1:42451)
0810 06:34:46.037872 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:46.037889 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:46.037929 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:34:46.038605 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:46.038625 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:46.039025 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:46.039393 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:46.040260 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:46.041316 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:46.042264 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:46.042768 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:46.042927 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:46.045797 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:46.045803 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:46.045819 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:46.045849 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:46.047512 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:46.048044 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:46.048050 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:46.048056 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:46.048177 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:46.048518 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:46.048521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:46.048523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:46.048968 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:46.049212 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:46.049591 (+ 379us) server_negotiation.cc:299] Negotiation successful
0810 06:34:46.049839 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":177,"threads_started":1}
I20260810 06:34:46.051111 23746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1782f6a5c9f2450aaac83d2238f7dbb3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42451 } }
I20260810 06:34:46.051292 23746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:46.051357 23746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:46.051468 23746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:46.052577 23746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1782f6a5c9f2450aaac83d2238f7dbb3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42451 } }
I20260810 06:34:46.052981 23746 leader_election.cc:302] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1782f6a5c9f2450aaac83d2238f7dbb3; no voters:
I20260810 06:34:46.053397 23746 leader_election.cc:288] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:46.053503 23752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:46.053781 23752 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [term 1 LEADER]: Becoming Leader. State: Replica: 1782f6a5c9f2450aaac83d2238f7dbb3, State: Running, Role: LEADER
I20260810 06:34:46.054196 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:46.054198 23752 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1782f6a5c9f2450aaac83d2238f7dbb3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42451 } }
I20260810 06:34:46.054914 23746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:46.056810 23755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1782f6a5c9f2450aaac83d2238f7dbb3. Latest consensus state: current_term: 1 leader_uuid: "1782f6a5c9f2450aaac83d2238f7dbb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1782f6a5c9f2450aaac83d2238f7dbb3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42451 } } }
I20260810 06:34:46.056955 23755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:46.057257 23754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1782f6a5c9f2450aaac83d2238f7dbb3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1782f6a5c9f2450aaac83d2238f7dbb3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42451 } } }
I20260810 06:34:46.057358 23754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3 [sys.catalog]: This master's current role is: LEADER
W20260810 06:34:46.060205 23791 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:34:46.060277 23791 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:34:46.060351 23792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:46.061295 23792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:46.067211 23749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:46.056947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:36923 (local address 127.0.0.1:42451)
0810 06:34:46.057055 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:46.057059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:46.058056 (+ 997us) server_negotiation.cc:407] Connection header received
0810 06:34:46.058166 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:46.058170 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:46.058217 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:46.058287 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:46.059006 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:46.059754 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:46.061977 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:46.062209 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:46.062303 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:46.063739 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:46.063742 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:46.063744 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:46.063768 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:46.065133 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:46.065631 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:46.065635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:46.065636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:46.065718 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:46.066152 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:46.066155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:46.066157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:46.066421 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:46.066579 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:46.066932 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 06:34:46.067051 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 06:34:46.068240 23792 catalog_manager.cc:1347] Generated new cluster ID: 99fbe920a7ca49719227443300ef2948
I20260810 06:34:46.068401 23792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:46.086344 23792 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:46.087383 23792 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:46.092612 23792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1782f6a5c9f2450aaac83d2238f7dbb3: Generated new TSK 0
I20260810 06:34:46.093439 23792 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:46.102336 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23654
W20260810 06:34:46.118511 23627 connection.cc:535] client connection to 127.0.0.1:42451 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42451): Connection reset by peer (error 104)
2026-08-10T06:34:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:46 dist-test-slave-7lbf krb5kdc[23801](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:46 dist-test-slave-7lbf krb5kdc[23801](info): set up 2 sockets
Aug 10 06:34:46 dist-test-slave-7lbf krb5kdc[23801](info): commencing operation
krb5kdc: starting...
W20260810 06:34:47.274297 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:47 dist-test-slave-7lbf krb5kdc[23801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:47.405377 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38223
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:47.530678 23821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:47.531097 23821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:47.531174 23821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:47.535498 23821 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:47.535600 23821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:47.535635 23821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:47.535665 23821 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:47.535699 23821 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:47.541649 23821 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:47.542954 23821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:47.544190 23821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:47.553849 23837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:47.553853 23833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:47.553853 23834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:47.553977 23821 server_base.cc:1034] running on GCE node
I20260810 06:34:47.554824 23821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:47.556083 23821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:47.557253 23821 hybrid_clock.cc:648] HybridClock initialized: now 1786343687557231 us; error 38 us; skew 500 ppm
Aug 10 06:34:47 dist-test-slave-7lbf krb5kdc[23801](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343687, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:47.560261 23821 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:47.561288 23821 webserver.cc:460] Webserver started at http://127.0.0.1:42881/ using document root <none> and password file <none>
I20260810 06:34:47.561945 23821 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:47.562024 23821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:47.562263 23821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:47.564594 23821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "bb003fb6c1164dae8ef9e49c21ec1c54"
format_stamp: "Formatted at 2026-08-10 06:34:47 on dist-test-slave-7lbf"
server_key: "18f8c11ab6cc980da69d81da12bfd131"
server_key_iv: "2372f8f5a6e1550d6c74e8d03242c8f3"
server_key_version: "encryptionkey@0"
I20260810 06:34:47.565214 23821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "bb003fb6c1164dae8ef9e49c21ec1c54"
format_stamp: "Formatted at 2026-08-10 06:34:47 on dist-test-slave-7lbf"
server_key: "18f8c11ab6cc980da69d81da12bfd131"
server_key_iv: "2372f8f5a6e1550d6c74e8d03242c8f3"
server_key_version: "encryptionkey@0"
I20260810 06:34:47.569613 23821 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260810 06:34:47.572279 23844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:47.573863 23821 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:47.574028 23821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "bb003fb6c1164dae8ef9e49c21ec1c54"
format_stamp: "Formatted at 2026-08-10 06:34:47 on dist-test-slave-7lbf"
server_key: "18f8c11ab6cc980da69d81da12bfd131"
server_key_iv: "2372f8f5a6e1550d6c74e8d03242c8f3"
server_key_version: "encryptionkey@0"
I20260810 06:34:47.574157 23821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:47.606600 23821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:47.610585 23821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:47.610831 23821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:47.619001 23821 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38223
I20260810 06:34:47.619024 23941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38223 every 8 connection(s)
I20260810 06:34:47.620172 23821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:47.623390 23942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:47.623770 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 23821
I20260810 06:34:47.623908 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:47.624198 22287 external_mini_cluster.cc:1428] Setting key 32d2eb309ce6b2278cb7abf03895fb1b
I20260810 06:34:47.630155 23942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54: Bootstrap starting.
I20260810 06:34:47.632773 23942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:47.633635 23942 log.cc:824] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:47.635006 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:47.625892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:48995 (local address 127.0.0.1:38223)
0810 06:34:47.626417 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:47.626437 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:47.626480 (+ 43us) server_negotiation.cc:407] Connection header received
0810 06:34:47.627169 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:47.627187 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:47.627599 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:47.627964 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:47.628439 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:47.629497 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:47.631037 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:47.631589 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:47.631773 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:47.632810 (+ 1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:47.632816 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:47.632833 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:47.633334 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:47.633407 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:47.633438 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:47.633640 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:47.633842 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 06:34:47.634009 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":161,"threads_started":1}
I20260810 06:34:47.636196 23942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54: No bootstrap required, opened a new log
I20260810 06:34:47.638397 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:47.640389 23942 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb003fb6c1164dae8ef9e49c21ec1c54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38223 } }
I20260810 06:34:47.640723 23942 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:47.640792 23942 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb003fb6c1164dae8ef9e49c21ec1c54, State: Initialized, Role: FOLLOWER
I20260810 06:34:47.641290 23942 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb003fb6c1164dae8ef9e49c21ec1c54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38223 } }
I20260810 06:34:47.641448 23942 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:47.641541 23942 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:47.641659 23942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:47.642755 23942 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb003fb6c1164dae8ef9e49c21ec1c54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38223 } }
I20260810 06:34:47.643157 23942 leader_election.cc:302] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb003fb6c1164dae8ef9e49c21ec1c54; no voters:
I20260810 06:34:47.643504 23942 leader_election.cc:288] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:47.643600 23955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:47.643788 23955 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [term 1 LEADER]: Becoming Leader. State: Replica: bb003fb6c1164dae8ef9e49c21ec1c54, State: Running, Role: LEADER
I20260810 06:34:47.644153 23955 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb003fb6c1164dae8ef9e49c21ec1c54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38223 } }
I20260810 06:34:47.644924 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:47.640484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:47425 (local address 127.0.0.1:38223)
0810 06:34:47.640623 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:47.640627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:47.640844 (+ 217us) server_negotiation.cc:407] Connection header received
0810 06:34:47.640985 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:47.640989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:47.641040 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:47.641108 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:47.641391 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:47.642055 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:47.642896 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:47.643161 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:47.643293 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:47.644181 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:47.644185 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:47.644188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:47.644204 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:47.644245 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:47.644260 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:47.644720 (+ 460us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:47.644776 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:34:47.644814 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:34:47.645068 23942 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:47.646162 23956 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb003fb6c1164dae8ef9e49c21ec1c54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb003fb6c1164dae8ef9e49c21ec1c54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38223 } } }
I20260810 06:34:47.646206 23957 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb003fb6c1164dae8ef9e49c21ec1c54. Latest consensus state: current_term: 1 leader_uuid: "bb003fb6c1164dae8ef9e49c21ec1c54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb003fb6c1164dae8ef9e49c21ec1c54" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38223 } } }
I20260810 06:34:47.646311 23956 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:47.646311 23957 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:47.646720 23966 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:47.650264 23966 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:47.655995 23966 catalog_manager.cc:1347] Generated new cluster ID: 5a46afe148754613a152fc2ffe57efcd
I20260810 06:34:47.656070 23966 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:47.675642 23966 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:47.676751 23966 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:47.683027 23966 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb003fb6c1164dae8ef9e49c21ec1c54: Generated new TSK 0
I20260810 06:34:47.683833 23966 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:47.694420 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 23821
W20260810 06:34:47.711709 23797 connection.cc:535] client connection to 127.0.0.1:38223 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38223): Connection reset by peer (error 104)
2026-08-10T06:34:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1593 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:47 dist-test-slave-7lbf krb5kdc[23993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:47 dist-test-slave-7lbf krb5kdc[23993](info): set up 2 sockets
Aug 10 06:34:47 dist-test-slave-7lbf krb5kdc[23993](info): commencing operation
krb5kdc: starting...
W20260810 06:34:48.877115 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:48 dist-test-slave-7lbf krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:49.010829 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44781
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:49.134119 24017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:49.134449 24017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:49.134511 24017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:49.138718 24017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:49.138804 24017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:49.138832 24017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:49.138855 24017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:49.138875 24017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:49.144676 24017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:49.146003 24017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:49.147374 24017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:49.157037 24025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:49.157218 24017 server_base.cc:1034] running on GCE node
W20260810 06:34:49.157037 24028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:49.157117 24026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:49.157902 24017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:49.159173 24017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:49.160337 24017 hybrid_clock.cc:648] HybridClock initialized: now 1786343689160318 us; error 35 us; skew 500 ppm
Aug 10 06:34:49 dist-test-slave-7lbf krb5kdc[23993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343689, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:49.163412 24017 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:49.164455 24017 webserver.cc:460] Webserver started at http://127.0.0.1:33841/ using document root <none> and password file <none>
I20260810 06:34:49.165096 24017 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:49.165179 24017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:49.165411 24017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:49.167764 24017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "7912f4aef93b47f9869186e28aa1cceb"
format_stamp: "Formatted at 2026-08-10 06:34:49 on dist-test-slave-7lbf"
server_key: "ea1ed5dbde2869bfce851b9f10c09c71"
server_key_iv: "62aa4bdf85c016cc37061df2cdc9c73a"
server_key_version: "encryptionkey@0"
I20260810 06:34:49.168395 24017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "7912f4aef93b47f9869186e28aa1cceb"
format_stamp: "Formatted at 2026-08-10 06:34:49 on dist-test-slave-7lbf"
server_key: "ea1ed5dbde2869bfce851b9f10c09c71"
server_key_iv: "62aa4bdf85c016cc37061df2cdc9c73a"
server_key_version: "encryptionkey@0"
I20260810 06:34:49.172704 24017 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260810 06:34:49.175611 24039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:49.177079 24017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:34:49.177218 24017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "7912f4aef93b47f9869186e28aa1cceb"
format_stamp: "Formatted at 2026-08-10 06:34:49 on dist-test-slave-7lbf"
server_key: "ea1ed5dbde2869bfce851b9f10c09c71"
server_key_iv: "62aa4bdf85c016cc37061df2cdc9c73a"
server_key_version: "encryptionkey@0"
I20260810 06:34:49.177335 24017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:49.182350 24017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:49.185382 24017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:49.185599 24017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:49.192999 24017 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44781
I20260810 06:34:49.193005 24124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44781 every 8 connection(s)
I20260810 06:34:49.194173 24017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:49.197328 24128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:49.199010 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24017
I20260810 06:34:49.199159 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:49.199532 22287 external_mini_cluster.cc:1428] Setting key c034fff1f4024395e4af31b53aeab65b
I20260810 06:34:49.204532 24128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb: Bootstrap starting.
I20260810 06:34:49.205190 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:49.201117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:41815 (local address 127.0.0.1:44781)
0810 06:34:49.201654 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:49.201673 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:49.201712 (+ 39us) server_negotiation.cc:407] Connection header received
0810 06:34:49.202379 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:49.202396 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:49.202728 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:49.203072 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:49.203882 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:49.203887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:49.203900 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:49.203911 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:49.203972 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:49.203993 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:49.204131 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:49.204208 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 06:34:49.204381 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":150,"threads_started":1}
I20260810 06:34:49.207228 24128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:49.208154 24128 log.cc:824] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:49.208477 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:49.210450 24128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb: No bootstrap required, opened a new log
I20260810 06:34:49.212327 24133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:49.210726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:51937 (local address 127.0.0.1:44781)
0810 06:34:49.210851 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:49.210856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:49.211027 (+ 171us) server_negotiation.cc:407] Connection header received
0810 06:34:49.211121 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:49.211124 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:49.211162 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:49.211241 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:49.211962 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:49.211966 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:49.211968 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:49.211982 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:49.212014 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:49.212027 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:49.212118 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:49.212158 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 06:34:49.212198 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 06:34:49.214963 24128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7912f4aef93b47f9869186e28aa1cceb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44781 } }
I20260810 06:34:49.215237 24128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:49.215273 24128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7912f4aef93b47f9869186e28aa1cceb, State: Initialized, Role: FOLLOWER
I20260810 06:34:49.215747 24128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7912f4aef93b47f9869186e28aa1cceb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44781 } }
I20260810 06:34:49.215883 24128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:49.215956 24128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:49.216058 24128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:49.217079 24128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7912f4aef93b47f9869186e28aa1cceb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44781 } }
I20260810 06:34:49.217486 24128 leader_election.cc:302] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7912f4aef93b47f9869186e28aa1cceb; no voters:
I20260810 06:34:49.217888 24128 leader_election.cc:288] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:49.218019 24145 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:49.218310 24145 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [term 1 LEADER]: Becoming Leader. State: Replica: 7912f4aef93b47f9869186e28aa1cceb, State: Running, Role: LEADER
I20260810 06:34:49.218677 24145 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7912f4aef93b47f9869186e28aa1cceb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44781 } }
I20260810 06:34:49.219260 24128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:49.220553 24146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7912f4aef93b47f9869186e28aa1cceb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7912f4aef93b47f9869186e28aa1cceb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44781 } } }
I20260810 06:34:49.220695 24146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:49.221052 24148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7912f4aef93b47f9869186e28aa1cceb. Latest consensus state: current_term: 1 leader_uuid: "7912f4aef93b47f9869186e28aa1cceb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7912f4aef93b47f9869186e28aa1cceb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44781 } } }
I20260810 06:34:49.221215 24148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:49.221840 24162 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:49.224876 24162 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:49.231245 24162 catalog_manager.cc:1347] Generated new cluster ID: 2a5ae7f434ea4e0b8f1099513f9f7b47
I20260810 06:34:49.231348 24162 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:49.239365 24162 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:49.239769 24162 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:49.248904 24162 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7912f4aef93b47f9869186e28aa1cceb: Generated new TSK 0
I20260810 06:34:49.249969 24162 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:49.257067 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24017
2026-08-10T06:34:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1590 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:49 dist-test-slave-7lbf krb5kdc[24182](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:49 dist-test-slave-7lbf krb5kdc[24182](info): set up 2 sockets
Aug 10 06:34:49 dist-test-slave-7lbf krb5kdc[24182](info): commencing operation
krb5kdc: starting...
W20260810 06:34:50.482848 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:50 dist-test-slave-7lbf krb5kdc[24182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:50.615999 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34263
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:50.740031 24207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:50.740370 24207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:50.740433 24207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:50.744743 24207 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:50.744832 24207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:50.744860 24207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:50.744880 24207 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:50.744902 24207 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:50.750723 24207 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34263
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:50.751991 24207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:50.753180 24207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:50.763787 24213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:50.763799 24216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:50.764048 24207 server_base.cc:1034] running on GCE node
W20260810 06:34:50.764132 24214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:50.764710 24207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:50.766026 24207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:50.767198 24207 hybrid_clock.cc:648] HybridClock initialized: now 1786343690767177 us; error 38 us; skew 500 ppm
Aug 10 06:34:50 dist-test-slave-7lbf krb5kdc[24182](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343690, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:50.770277 24207 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:50.771363 24207 webserver.cc:460] Webserver started at http://127.0.0.1:41401/ using document root <none> and password file <none>
I20260810 06:34:50.771979 24207 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:50.772053 24207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:50.772279 24207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:50.774674 24207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "43fae05eecaf42c585cf5451784fe3ef"
format_stamp: "Formatted at 2026-08-10 06:34:50 on dist-test-slave-7lbf"
server_key: "02940c9a0325a82d8d712fe78c3373d2"
server_key_iv: "d02245bfdf65c656a35a87fa56dc4a29"
server_key_version: "encryptionkey@0"
I20260810 06:34:50.775352 24207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "43fae05eecaf42c585cf5451784fe3ef"
format_stamp: "Formatted at 2026-08-10 06:34:50 on dist-test-slave-7lbf"
server_key: "02940c9a0325a82d8d712fe78c3373d2"
server_key_iv: "d02245bfdf65c656a35a87fa56dc4a29"
server_key_version: "encryptionkey@0"
I20260810 06:34:50.779677 24207 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:34:50.782529 24226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:50.783941 24207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260810 06:34:50.784083 24207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "43fae05eecaf42c585cf5451784fe3ef"
format_stamp: "Formatted at 2026-08-10 06:34:50 on dist-test-slave-7lbf"
server_key: "02940c9a0325a82d8d712fe78c3373d2"
server_key_iv: "d02245bfdf65c656a35a87fa56dc4a29"
server_key_version: "encryptionkey@0"
I20260810 06:34:50.784199 24207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:50.812769 24207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:50.816414 24207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:50.816658 24207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:50.824326 24207 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34263
I20260810 06:34:50.824339 24310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34263 every 8 connection(s)
I20260810 06:34:50.825454 24207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:50.828678 24311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:50.835068 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24207
I20260810 06:34:50.835245 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:50.835439 24311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef: Bootstrap starting.
I20260810 06:34:50.835551 22287 external_mini_cluster.cc:1428] Setting key 28be26b0290f8207a75b05cda61959f8
I20260810 06:34:50.838521 24311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:50.839346 24311 log.cc:824] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:50.842008 24311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef: No bootstrap required, opened a new log
Aug 10 06:34:50 dist-test-slave-7lbf krb5kdc[24182](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 06:34:50.846544 24311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fae05eecaf42c585cf5451784fe3ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34263 } }
I20260810 06:34:50.846935 24311 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:50.846999 24311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43fae05eecaf42c585cf5451784fe3ef, State: Initialized, Role: FOLLOWER
I20260810 06:34:50.847496 24311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fae05eecaf42c585cf5451784fe3ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34263 } }
I20260810 06:34:50.847630 24311 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:50.847757 24311 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:50.847893 24311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:50.849182 24311 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fae05eecaf42c585cf5451784fe3ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34263 } }
I20260810 06:34:50.849645 24311 leader_election.cc:302] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43fae05eecaf42c585cf5451784fe3ef; no voters:
I20260810 06:34:50.850050 24311 leader_election.cc:288] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:50.850145 24319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:50.850348 24319 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [term 1 LEADER]: Becoming Leader. State: Replica: 43fae05eecaf42c585cf5451784fe3ef, State: Running, Role: LEADER
I20260810 06:34:50.850775 24319 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fae05eecaf42c585cf5451784fe3ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34263 } }
I20260810 06:34:50.851639 24311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:50.852588 24323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43fae05eecaf42c585cf5451784fe3ef. Latest consensus state: current_term: 1 leader_uuid: "43fae05eecaf42c585cf5451784fe3ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fae05eecaf42c585cf5451784fe3ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34263 } } }
I20260810 06:34:50.852736 24323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:50.852900 24314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:50.837021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:42297 (local address 127.0.0.1:34263)
0810 06:34:50.837578 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:50.837597 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:50.837641 (+ 44us) server_negotiation.cc:407] Connection header received
0810 06:34:50.838410 (+ 769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:50.838431 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:50.838881 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:50.839237 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:50.840159 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:50.841729 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:50.842702 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:50.843427 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:50.843631 (+ 204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:50.846461 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:50.846468 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:50.846488 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:50.846527 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:50.848773 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:50.849355 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:50.849362 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:50.849369 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:50.849575 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:50.849917 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:50.849922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:50.849924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:50.850518 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:50.851379 (+ 861us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:50.851556 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 06:34:50.851783 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":172,"threads_started":1}
I20260810 06:34:50.853071 24321 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43fae05eecaf42c585cf5451784fe3ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43fae05eecaf42c585cf5451784fe3ef" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34263 } } }
I20260810 06:34:50.853158 24321 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:50.856639 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 06:34:50.857179 24342 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:34:50.857264 24342 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:34:50.857354 24332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:50.858377 24332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:50.864517 24332 catalog_manager.cc:1347] Generated new cluster ID: bb3ab95d8e3f4a96b5152a6ed9259beb
I20260810 06:34:50.864606 24332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:50.872256 24314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:50.859074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:58691 (local address 127.0.0.1:34263)
0810 06:34:50.859202 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:50.859207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:50.862925 (+ 3718us) server_negotiation.cc:407] Connection header received
0810 06:34:50.863080 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:50.863083 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:50.863141 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:50.863233 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:50.864216 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:50.865091 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:50.866341 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:50.866707 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:50.866829 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:50.868560 (+ 1731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:50.868565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:50.868568 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:50.868599 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:50.870340 (+ 1741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:50.870924 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:50.870928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:50.870930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:50.871030 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:50.871331 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:50.871335 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:50.871337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:50.871571 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:50.871722 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:50.871966 (+ 244us) server_negotiation.cc:299] Negotiation successful
0810 06:34:50.872077 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:34:50.876402 24332 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:50.877879 24332 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:50.888598 24332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43fae05eecaf42c585cf5451784fe3ef: Generated new TSK 0
I20260810 06:34:50.889734 24332 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:50.895197 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24207
W20260810 06:34:50.913349 24180 connection.cc:535] client connection to 127.0.0.1:34263 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34263): Connection reset by peer (error 104)
2026-08-10T06:34:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:50 dist-test-slave-7lbf krb5kdc[24358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:50 dist-test-slave-7lbf krb5kdc[24358](info): set up 2 sockets
Aug 10 06:34:50 dist-test-slave-7lbf krb5kdc[24358](info): commencing operation
krb5kdc: starting...
W20260810 06:34:52.076133 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:52 dist-test-slave-7lbf krb5kdc[24358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:52.206729 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39693
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:52.328063 24376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:52.328413 24376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:52.328485 24376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:52.332774 24376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:52.332868 24376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:52.332897 24376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:52.332921 24376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:52.332962 24376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:52.338888 24376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39693
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:52.340149 24376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:52.341320 24376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:34:52.350793 24376 server_base.cc:1034] running on GCE node
W20260810 06:34:52.350731 24387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:52.350731 24390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:52.350744 24386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:52.351699 24376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:52.352978 24376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:52.354151 24376 hybrid_clock.cc:648] HybridClock initialized: now 1786343692354125 us; error 42 us; skew 500 ppm
Aug 10 06:34:52 dist-test-slave-7lbf krb5kdc[24358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343692, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:52.361162 24376 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:52.362349 24376 webserver.cc:460] Webserver started at http://127.0.0.1:39843/ using document root <none> and password file <none>
I20260810 06:34:52.363003 24376 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:52.363085 24376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:52.363328 24376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:52.365696 24376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "4b094f0b90654af08ab776eda2591dc0"
format_stamp: "Formatted at 2026-08-10 06:34:52 on dist-test-slave-7lbf"
server_key: "1bab8752369799b6a04979b4e2418c8d"
server_key_iv: "07744f3f6404ffdf1a6c0d8d408fd1c5"
server_key_version: "encryptionkey@0"
I20260810 06:34:52.366353 24376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "4b094f0b90654af08ab776eda2591dc0"
format_stamp: "Formatted at 2026-08-10 06:34:52 on dist-test-slave-7lbf"
server_key: "1bab8752369799b6a04979b4e2418c8d"
server_key_iv: "07744f3f6404ffdf1a6c0d8d408fd1c5"
server_key_version: "encryptionkey@0"
I20260810 06:34:52.370649 24376 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:52.373373 24401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:52.374897 24376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:52.375041 24376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "4b094f0b90654af08ab776eda2591dc0"
format_stamp: "Formatted at 2026-08-10 06:34:52 on dist-test-slave-7lbf"
server_key: "1bab8752369799b6a04979b4e2418c8d"
server_key_iv: "07744f3f6404ffdf1a6c0d8d408fd1c5"
server_key_version: "encryptionkey@0"
I20260810 06:34:52.375154 24376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:52.392949 24376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:52.396700 24376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:52.396898 24376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:52.404559 24376 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39693
I20260810 06:34:52.404596 24480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39693 every 8 connection(s)
I20260810 06:34:52.405715 24376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:52.408970 24482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:52.414842 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24376
I20260810 06:34:52.415009 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:52.415324 22287 external_mini_cluster.cc:1428] Setting key 3181ad781cbdb39c8a63539ec86ba6a7
I20260810 06:34:52.415791 24482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0: Bootstrap starting.
I20260810 06:34:52.418602 24482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:52.419417 24482 log.cc:824] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:52.421602 24482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0: No bootstrap required, opened a new log
I20260810 06:34:52.425141 24486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:52.416936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:53307 (local address 127.0.0.1:39693)
0810 06:34:52.417480 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:52.417497 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:52.417571 (+ 74us) server_negotiation.cc:407] Connection header received
0810 06:34:52.418285 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:52.418305 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:52.418733 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:52.419107 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:52.419600 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:52.420635 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:52.421604 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:52.422143 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:52.422310 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:52.423299 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:52.423305 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:52.423321 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:52.423755 (+ 434us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:52.423817 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:52.423843 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:52.423970 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:52.424175 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 06:34:52.424326 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":160,"threads_started":1}
I20260810 06:34:52.425688 24482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b094f0b90654af08ab776eda2591dc0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39693 } }
I20260810 06:34:52.425961 24482 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:52.426036 24482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b094f0b90654af08ab776eda2591dc0, State: Initialized, Role: FOLLOWER
I20260810 06:34:52.426514 24482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b094f0b90654af08ab776eda2591dc0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39693 } }
I20260810 06:34:52.426661 24482 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:52.426730 24482 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:52.426844 24482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:52.428020 24482 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b094f0b90654af08ab776eda2591dc0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39693 } }
I20260810 06:34:52.428337 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:52.428395 24482 leader_election.cc:302] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b094f0b90654af08ab776eda2591dc0; no voters:
I20260810 06:34:52.428750 24482 leader_election.cc:288] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:52.428856 24488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:52.429045 24488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [term 1 LEADER]: Becoming Leader. State: Replica: 4b094f0b90654af08ab776eda2591dc0, State: Running, Role: LEADER
I20260810 06:34:52.429451 24488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b094f0b90654af08ab776eda2591dc0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39693 } }
I20260810 06:34:52.430291 24482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:52.431463 24490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b094f0b90654af08ab776eda2591dc0. Latest consensus state: current_term: 1 leader_uuid: "4b094f0b90654af08ab776eda2591dc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b094f0b90654af08ab776eda2591dc0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39693 } } }
I20260810 06:34:52.431610 24490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:52.431610 24489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b094f0b90654af08ab776eda2591dc0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b094f0b90654af08ab776eda2591dc0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39693 } } }
I20260810 06:34:52.431721 24489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:52.435855 24486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:52.430611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:52187 (local address 127.0.0.1:39693)
0810 06:34:52.430746 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:52.430750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:52.431033 (+ 283us) server_negotiation.cc:407] Connection header received
0810 06:34:52.431342 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:52.431346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:52.431404 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:52.431472 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:52.432155 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:52.432932 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:52.434180 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:52.434403 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:52.434511 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:52.435378 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:52.435381 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:52.435384 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:52.435399 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:52.435436 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:52.435448 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:52.435526 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:52.435672 (+ 146us) server_negotiation.cc:299] Negotiation successful
0810 06:34:52.435710 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 06:34:52.436126 24517 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:34:52.436215 24517 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:34:52.436299 24510 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:52.437216 24510 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:52.443686 24510 catalog_manager.cc:1347] Generated new cluster ID: a3938bba65a74ca0a398f52591bc7802
I20260810 06:34:52.443765 24510 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:52.454813 24510 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:52.455956 24510 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:52.460881 24510 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b094f0b90654af08ab776eda2591dc0: Generated new TSK 0
I20260810 06:34:52.461743 24510 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:52.465631 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24376
W20260810 06:34:52.487576 24356 connection.cc:535] client connection to 127.0.0.1:39693 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39693): Connection reset by peer (error 104)
2026-08-10T06:34:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1574 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:52 dist-test-slave-7lbf krb5kdc[24534](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:52 dist-test-slave-7lbf krb5kdc[24534](info): set up 2 sockets
Aug 10 06:34:52 dist-test-slave-7lbf krb5kdc[24534](info): commencing operation
krb5kdc: starting...
W20260810 06:34:53.642014 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:53 dist-test-slave-7lbf krb5kdc[24534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 06:34:53.774091 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:53.896540 24549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:53.896914 24549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:53.896962 24549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:53.901437 24549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:53.901554 24549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:53.901587 24549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:53.901619 24549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:53.901643 24549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:53.907512 24549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39121
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:53.908741 24549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:53.909952 24549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:53.920529 24558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:53.920523 24557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:53.920516 24560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:53.922039 24549 server_base.cc:1034] running on GCE node
I20260810 06:34:53.922782 24549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:53.925266 24549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:53.926445 24549 hybrid_clock.cc:648] HybridClock initialized: now 1786343693926417 us; error 42 us; skew 500 ppm
Aug 10 06:34:53 dist-test-slave-7lbf krb5kdc[24534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343693, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:53.930011 24549 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 06:34:53.931113 24549 webserver.cc:460] Webserver started at http://127.0.0.1:42815/ using document root <none> and password file <none>
I20260810 06:34:53.931993 24549 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:53.932096 24549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:53.932394 24549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:53.935935 24549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "dcd460337ab9494bbdc7a74435a1135d"
format_stamp: "Formatted at 2026-08-10 06:34:53 on dist-test-slave-7lbf"
server_key: "a05d73a2302361f09763e00d085340e9"
server_key_iv: "e61f00991ee425e0046737724fb7edcd"
server_key_version: "encryptionkey@0"
I20260810 06:34:53.936792 24549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "dcd460337ab9494bbdc7a74435a1135d"
format_stamp: "Formatted at 2026-08-10 06:34:53 on dist-test-slave-7lbf"
server_key: "a05d73a2302361f09763e00d085340e9"
server_key_iv: "e61f00991ee425e0046737724fb7edcd"
server_key_version: "encryptionkey@0"
I20260810 06:34:53.941896 24549 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260810 06:34:53.945273 24570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:53.947038 24549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:53.947170 24549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "dcd460337ab9494bbdc7a74435a1135d"
format_stamp: "Formatted at 2026-08-10 06:34:53 on dist-test-slave-7lbf"
server_key: "a05d73a2302361f09763e00d085340e9"
server_key_iv: "e61f00991ee425e0046737724fb7edcd"
server_key_version: "encryptionkey@0"
I20260810 06:34:53.947283 24549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:53.953562 24549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:53.958074 24549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:53.958318 24549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:53.968231 24549 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39121
I20260810 06:34:53.968232 24650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39121 every 8 connection(s)
I20260810 06:34:53.969759 24549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:53.972460 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24549
I20260810 06:34:53.972612 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:53.972949 22287 external_mini_cluster.cc:1428] Setting key 8a7759881a094bdabd49ca2722796ac3
I20260810 06:34:53.973327 24651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:53.978672 24660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:53.974578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:47817 (local address 127.0.0.1:39121)
0810 06:34:53.975084 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:53.975101 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:53.975143 (+ 42us) server_negotiation.cc:407] Connection header received
0810 06:34:53.975836 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:53.975855 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:53.976172 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:53.976484 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:53.977336 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:53.977342 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:53.977354 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:53.977364 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:53.977421 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:53.977441 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:53.977608 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:53.977680 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 06:34:53.977885 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":158,"threads_started":1}
I20260810 06:34:53.980726 24651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d: Bootstrap starting.
I20260810 06:34:53.981709 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:53.983726 24651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:53.984716 24651 log.cc:824] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:53.985716 24660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:53.984070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.224:35803 (local address 127.0.0.1:39121)
0810 06:34:53.984202 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:53.984206 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:53.984393 (+ 187us) server_negotiation.cc:407] Connection header received
0810 06:34:53.984524 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:53.984526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:53.984560 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:53.984622 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:53.985322 (+ 700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:53.985326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:53.985329 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:53.985341 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:53.985369 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:53.985381 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:53.985474 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:53.985553 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 06:34:53.985596 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:34:53.987401 24651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d: No bootstrap required, opened a new log
I20260810 06:34:53.991254 24651 raft_consensus.cc:348] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcd460337ab9494bbdc7a74435a1135d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39121 } }
I20260810 06:34:53.991561 24651 raft_consensus.cc:374] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:53.991624 24651 raft_consensus.cc:729] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dcd460337ab9494bbdc7a74435a1135d, State: Initialized, Role: FOLLOWER
I20260810 06:34:53.992110 24651 consensus_queue.cc:260] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcd460337ab9494bbdc7a74435a1135d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39121 } }
I20260810 06:34:53.992252 24651 raft_consensus.cc:388] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:53.992311 24651 raft_consensus.cc:482] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:53.992391 24651 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:53.993396 24651 raft_consensus.cc:504] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcd460337ab9494bbdc7a74435a1135d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39121 } }
I20260810 06:34:53.993781 24651 leader_election.cc:302] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dcd460337ab9494bbdc7a74435a1135d; no voters:
I20260810 06:34:53.994123 24651 leader_election.cc:288] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:53.994256 24667 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:53.994454 24667 raft_consensus.cc:686] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [term 1 LEADER]: Becoming Leader. State: Replica: dcd460337ab9494bbdc7a74435a1135d, State: Running, Role: LEADER
I20260810 06:34:53.994791 24667 consensus_queue.cc:237] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcd460337ab9494bbdc7a74435a1135d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39121 } }
I20260810 06:34:53.995450 24651 sys_catalog.cc:564] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:53.996592 24671 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dcd460337ab9494bbdc7a74435a1135d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcd460337ab9494bbdc7a74435a1135d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39121 } } }
I20260810 06:34:53.996642 24668 sys_catalog.cc:455] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dcd460337ab9494bbdc7a74435a1135d. Latest consensus state: current_term: 1 leader_uuid: "dcd460337ab9494bbdc7a74435a1135d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dcd460337ab9494bbdc7a74435a1135d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39121 } } }
I20260810 06:34:53.996722 24671 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:53.996744 24668 sys_catalog.cc:458] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:53.997151 24682 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:54.000265 24682 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:54.005986 24682 catalog_manager.cc:1347] Generated new cluster ID: d44516f5f0a8430ea6ade42a5fc1e314
I20260810 06:34:54.006074 24682 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:54.016913 24682 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:54.017261 24682 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:54.027928 24682 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dcd460337ab9494bbdc7a74435a1135d: Generated new TSK 0
I20260810 06:34:54.028792 24682 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:54.035657 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24549
2026-08-10T06:34:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1559 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:54 dist-test-slave-7lbf krb5kdc[24708](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:54 dist-test-slave-7lbf krb5kdc[24708](info): set up 2 sockets
Aug 10 06:34:54 dist-test-slave-7lbf krb5kdc[24708](info): commencing operation
krb5kdc: starting...
W20260810 06:34:55.220901 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:55 dist-test-slave-7lbf krb5kdc[24708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:34:55.354684 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:42775
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:42775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:55.476254 24725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:55.476621 24725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:55.476691 24725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:55.481004 24725 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:55.481106 24725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:55.481135 24725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:55.481158 24725 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:55.481176 24725 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:55.487039 24725 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:42775
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:42775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:55.488317 24725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:55.489508 24725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:55.499318 24735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:55.499322 24733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:55.499359 24738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:55.499519 24725 server_base.cc:1034] running on GCE node
I20260810 06:34:55.500283 24725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:55.501607 24725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:55.502774 24725 hybrid_clock.cc:648] HybridClock initialized: now 1786343695502754 us; error 37 us; skew 500 ppm
Aug 10 06:34:55 dist-test-slave-7lbf krb5kdc[24708](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343695, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:55.505669 24725 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:34:55.506695 24725 webserver.cc:460] Webserver started at http://127.21.195.254:44023/ using document root <none> and password file <none>
I20260810 06:34:55.507298 24725 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:55.507376 24725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:55.507601 24725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:55.509934 24725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "c7c9f82c3c1845abb97613b7a0ae3831"
format_stamp: "Formatted at 2026-08-10 06:34:55 on dist-test-slave-7lbf"
server_key: "5ac8042584875558ca3a05b21620f5ac"
server_key_iv: "1e825e1ff9bec6f24891db5662992eac"
server_key_version: "encryptionkey@0"
I20260810 06:34:55.510555 24725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "c7c9f82c3c1845abb97613b7a0ae3831"
format_stamp: "Formatted at 2026-08-10 06:34:55 on dist-test-slave-7lbf"
server_key: "5ac8042584875558ca3a05b21620f5ac"
server_key_iv: "1e825e1ff9bec6f24891db5662992eac"
server_key_version: "encryptionkey@0"
I20260810 06:34:55.514778 24725 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:34:55.517463 24747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:55.518921 24725 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260810 06:34:55.519057 24725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "c7c9f82c3c1845abb97613b7a0ae3831"
format_stamp: "Formatted at 2026-08-10 06:34:55 on dist-test-slave-7lbf"
server_key: "5ac8042584875558ca3a05b21620f5ac"
server_key_iv: "1e825e1ff9bec6f24891db5662992eac"
server_key_version: "encryptionkey@0"
I20260810 06:34:55.519171 24725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:55.536170 24725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:55.539623 24725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:55.539844 24725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:55.547291 24725 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:42775
I20260810 06:34:55.547308 24827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:42775 every 8 connection(s)
I20260810 06:34:55.548370 24725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:55.551695 24828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:55.553032 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24725
I20260810 06:34:55.553174 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:55.553453 22287 external_mini_cluster.cc:1428] Setting key 70e22e0faead7f72e0102f983c0adf86
I20260810 06:34:55.558511 24828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831: Bootstrap starting.
I20260810 06:34:55.561050 24828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:55.561918 24828 log.cc:824] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831: Log is configured to *not* fsync() on all Append() calls
Aug 10 06:34:55 dist-test-slave-7lbf krb5kdc[24708](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:34:55.564555 24828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831: No bootstrap required, opened a new log
I20260810 06:34:55.569029 24833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:55.554965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34187 (local address 127.21.195.254:42775)
0810 06:34:55.555457 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:55.555473 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:55.555512 (+ 39us) server_negotiation.cc:407] Connection header received
0810 06:34:55.556171 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:55.556189 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:55.556583 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:55.556932 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:55.557802 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:55.558858 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:55.559736 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:55.560240 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:55.560410 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:55.563220 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:55.563229 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:55.563248 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:55.563283 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:55.565248 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:55.565891 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:55.565897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:55.565904 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:55.566074 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:55.566464 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:55.566468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:55.566469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:55.567090 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:55.567314 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:55.567650 (+ 336us) server_negotiation.cc:299] Negotiation successful
0810 06:34:55.567926 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":142,"threads_started":1}
I20260810 06:34:55.569500 24828 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c9f82c3c1845abb97613b7a0ae3831" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42775 } }
I20260810 06:34:55.569849 24828 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:55.569904 24828 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c9f82c3c1845abb97613b7a0ae3831, State: Initialized, Role: FOLLOWER
I20260810 06:34:55.570485 24828 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c9f82c3c1845abb97613b7a0ae3831" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42775 } }
I20260810 06:34:55.570660 24828 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:55.570726 24828 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:55.570832 24828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:55.572085 24828 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c9f82c3c1845abb97613b7a0ae3831" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42775 } }
I20260810 06:34:55.572517 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:55.572487 24828 leader_election.cc:302] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7c9f82c3c1845abb97613b7a0ae3831; no voters:
I20260810 06:34:55.572814 24828 leader_election.cc:288] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:55.572914 24837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:55.573091 24837 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [term 1 LEADER]: Becoming Leader. State: Replica: c7c9f82c3c1845abb97613b7a0ae3831, State: Running, Role: LEADER
I20260810 06:34:55.573418 24837 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c9f82c3c1845abb97613b7a0ae3831" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42775 } }
I20260810 06:34:55.574301 24828 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:55.575196 24840 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7c9f82c3c1845abb97613b7a0ae3831. Latest consensus state: current_term: 1 leader_uuid: "c7c9f82c3c1845abb97613b7a0ae3831" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c9f82c3c1845abb97613b7a0ae3831" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42775 } } }
I20260810 06:34:55.575342 24840 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:55.575680 24839 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7c9f82c3c1845abb97613b7a0ae3831" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7c9f82c3c1845abb97613b7a0ae3831" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 42775 } } }
I20260810 06:34:55.575783 24839 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:55.576095 24855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:55.579738 24855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:55.585425 24833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:55.574821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38897 (local address 127.21.195.254:42775)
0810 06:34:55.574961 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:55.574966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:55.576919 (+ 1953us) server_negotiation.cc:407] Connection header received
0810 06:34:55.577132 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:55.577135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:55.577187 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:55.577272 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:55.578050 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:55.578889 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:55.579715 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:55.580052 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:55.580150 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:55.581643 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:55.581647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:55.581650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:34:55.581678 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:55.583334 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:55.583935 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:55.583939 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:55.583940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:55.584052 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:34:55.584444 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:34:55.584447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:34:55.584449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:34:55.584660 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:55.584756 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:55.585154 (+ 398us) server_negotiation.cc:299] Negotiation successful
0810 06:34:55.585270 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 06:34:55.587080 24855 catalog_manager.cc:1347] Generated new cluster ID: 3a14f966ac0441f381564228e6d9b9ec
I20260810 06:34:55.587145 24855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:55.612318 24855 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:55.613354 24855 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:55.621138 24855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7c9f82c3c1845abb97613b7a0ae3831: Generated new TSK 0
I20260810 06:34:55.622062 24855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:55.632326 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24725
W20260810 06:34:55.655031 24699 connection.cc:535] client connection to 127.21.195.254:42775 recv error: Network error: failed to read from TLS socket (remote: 127.21.195.254:42775): Connection reset by peer (error 104)
2026-08-10T06:34:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:55 dist-test-slave-7lbf krb5kdc[24875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:55 dist-test-slave-7lbf krb5kdc[24875](info): set up 2 sockets
Aug 10 06:34:55 dist-test-slave-7lbf krb5kdc[24875](info): commencing operation
krb5kdc: starting...
W20260810 06:34:56.809584 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:56 dist-test-slave-7lbf krb5kdc[24875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:34:56.942889 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:33905
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:45671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:33905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:57.067265 24892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:57.067657 24892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:57.067725 24892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:57.072366 24892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:57.072460 24892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:57.072480 24892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:57.072497 24892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:57.072511 24892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:57.078366 24892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:45671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:33905
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:33905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:57.079625 24892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:57.080747 24892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:57.090320 24900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:57.090322 24899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:57.090322 24905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:57.090750 24892 server_base.cc:1034] running on GCE node
I20260810 06:34:57.091399 24892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:57.092670 24892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:57.093833 24892 hybrid_clock.cc:648] HybridClock initialized: now 1786343697093812 us; error 37 us; skew 500 ppm
Aug 10 06:34:57 dist-test-slave-7lbf krb5kdc[24875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343697, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:57.097011 24892 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:34:57.098163 24892 webserver.cc:460] Webserver started at http://127.21.195.254:44485/ using document root <none> and password file <none>
I20260810 06:34:57.098785 24892 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:57.098861 24892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:57.099102 24892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:57.101464 24892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "4ee13063d73843f890b1d0aea4f17ac1"
format_stamp: "Formatted at 2026-08-10 06:34:57 on dist-test-slave-7lbf"
server_key: "443470f06d395dfa08fe94960bec4f0f"
server_key_iv: "b19438fa349b815a8a6cd05193799e5c"
server_key_version: "encryptionkey@0"
I20260810 06:34:57.102157 24892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "4ee13063d73843f890b1d0aea4f17ac1"
format_stamp: "Formatted at 2026-08-10 06:34:57 on dist-test-slave-7lbf"
server_key: "443470f06d395dfa08fe94960bec4f0f"
server_key_iv: "b19438fa349b815a8a6cd05193799e5c"
server_key_version: "encryptionkey@0"
I20260810 06:34:57.106398 24892 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260810 06:34:57.109097 24918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:57.110533 24892 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 06:34:57.110671 24892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "4ee13063d73843f890b1d0aea4f17ac1"
format_stamp: "Formatted at 2026-08-10 06:34:57 on dist-test-slave-7lbf"
server_key: "443470f06d395dfa08fe94960bec4f0f"
server_key_iv: "b19438fa349b815a8a6cd05193799e5c"
server_key_version: "encryptionkey@0"
I20260810 06:34:57.110788 24892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:57.133577 24892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:57.137151 24892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:57.137377 24892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:57.145076 24892 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:33905
I20260810 06:34:57.145093 25002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:33905 every 8 connection(s)
I20260810 06:34:57.146225 24892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:57.149438 25003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:57.151518 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 24892
I20260810 06:34:57.151681 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:57.152006 22287 external_mini_cluster.cc:1428] Setting key 6e1e5ada471377d022d4bebc21c66525
I20260810 06:34:57.156740 25003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1: Bootstrap starting.
I20260810 06:34:57.159363 25003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:57.160212 25003 log.cc:824] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:57.162061 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:57.153733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59655 (local address 127.21.195.254:33905)
0810 06:34:57.154242 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:57.154259 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:57.154299 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:34:57.155010 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:57.155031 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:57.155423 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:57.155769 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:57.156212 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:57.157284 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:57.158255 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:57.158777 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:57.158939 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:57.159929 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:57.159935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:57.159950 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:57.160395 (+ 445us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:57.160472 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:57.160499 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:57.160623 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:57.160833 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 06:34:57.160985 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":162,"threads_started":1}
I20260810 06:34:57.162735 25003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1: No bootstrap required, opened a new log
I20260810 06:34:57.165542 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:57.167398 25003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee13063d73843f890b1d0aea4f17ac1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33905 } }
I20260810 06:34:57.167732 25003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:57.167793 25003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ee13063d73843f890b1d0aea4f17ac1, State: Initialized, Role: FOLLOWER
I20260810 06:34:57.168308 25003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee13063d73843f890b1d0aea4f17ac1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33905 } }
I20260810 06:34:57.168483 25003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:57.168558 25003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:57.168673 25003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:57.169970 25003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee13063d73843f890b1d0aea4f17ac1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33905 } }
I20260810 06:34:57.170341 25003 leader_election.cc:302] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ee13063d73843f890b1d0aea4f17ac1; no voters:
I20260810 06:34:57.170727 25003 leader_election.cc:288] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:57.170816 25016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:57.171012 25016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [term 1 LEADER]: Becoming Leader. State: Replica: 4ee13063d73843f890b1d0aea4f17ac1, State: Running, Role: LEADER
I20260810 06:34:57.171343 25016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee13063d73843f890b1d0aea4f17ac1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33905 } }
I20260810 06:34:57.172242 25003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:57.172515 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:57.168002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52119 (local address 127.21.195.254:33905)
0810 06:34:57.168125 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:57.168130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:57.168333 (+ 203us) server_negotiation.cc:407] Connection header received
0810 06:34:57.168435 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:57.168438 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:57.168489 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:57.168585 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:57.168866 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:57.169638 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:57.170551 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:34:57.170840 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:34:57.170943 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:34:57.171974 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:57.171978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:57.171982 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:57.171997 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:57.172025 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:57.172038 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:57.172111 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:57.172266 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 06:34:57.172371 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:34:57.174161 25018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ee13063d73843f890b1d0aea4f17ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee13063d73843f890b1d0aea4f17ac1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33905 } } }
I20260810 06:34:57.174316 25018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:57.174626 25019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ee13063d73843f890b1d0aea4f17ac1. Latest consensus state: current_term: 1 leader_uuid: "4ee13063d73843f890b1d0aea4f17ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ee13063d73843f890b1d0aea4f17ac1" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 33905 } } }
I20260810 06:34:57.174728 25019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1 [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:57.174757 25044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:57.177793 25044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:57.184211 25044 catalog_manager.cc:1347] Generated new cluster ID: aac618aac6b2402dbc6e8436163dc790
I20260810 06:34:57.184311 25044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:57.206250 25044 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:57.207350 25044 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:57.218113 25044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ee13063d73843f890b1d0aea4f17ac1: Generated new TSK 0
I20260810 06:34:57.219165 25044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:57.230103 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 24892
W20260810 06:34:57.251235 24873 connection.cc:535] client connection to 127.21.195.254:33905 recv error: Network error: failed to read from TLS socket (remote: 127.21.195.254:33905): Connection reset by peer (error 104)
2026-08-10T06:34:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1596 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:57 dist-test-slave-7lbf krb5kdc[25054](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:57 dist-test-slave-7lbf krb5kdc[25054](info): set up 2 sockets
Aug 10 06:34:57 dist-test-slave-7lbf krb5kdc[25054](info): commencing operation
krb5kdc: starting...
W20260810 06:34:58.400815 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:34:58 dist-test-slave-7lbf krb5kdc[25054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343698, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:34:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:34:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:34:58.532524 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:32801
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:41731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:32801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:34:58.655607 25078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:34:58.655987 25078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:34:58.656056 25078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:34:58.660405 25078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:34:58.660502 25078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:34:58.660530 25078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:34:58.660552 25078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:34:58.660573 25078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:34:58.666468 25078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:41731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:32801
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:32801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:34:58.667760 25078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:34:58.668922 25078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:34:58.678367 25089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:58.678437 25078 server_base.cc:1034] running on GCE node
W20260810 06:34:58.678388 25091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:34:58.678376 25094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:34:58.679250 25078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:34:58.680529 25078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:34:58.681690 25078 hybrid_clock.cc:648] HybridClock initialized: now 1786343698681670 us; error 34 us; skew 500 ppm
Aug 10 06:34:58 dist-test-slave-7lbf krb5kdc[25054](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343698, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:34:58.687908 25078 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:34:58.689069 25078 webserver.cc:460] Webserver started at http://127.21.195.254:32911/ using document root <none> and password file <none>
I20260810 06:34:58.689783 25078 fs_manager.cc:359] Metadata directory not provided
I20260810 06:34:58.689880 25078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:34:58.690135 25078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:34:58.692551 25078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "3053577b461f4cfab885ee7072d2e05c"
format_stamp: "Formatted at 2026-08-10 06:34:58 on dist-test-slave-7lbf"
server_key: "3738944eb609a937a0204b1930bd803e"
server_key_iv: "466d9d955b8312659afc069f60bcd8f9"
server_key_version: "encryptionkey@0"
I20260810 06:34:58.693231 25078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "3053577b461f4cfab885ee7072d2e05c"
format_stamp: "Formatted at 2026-08-10 06:34:58 on dist-test-slave-7lbf"
server_key: "3738944eb609a937a0204b1930bd803e"
server_key_iv: "466d9d955b8312659afc069f60bcd8f9"
server_key_version: "encryptionkey@0"
I20260810 06:34:58.697839 25078 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:34:58.700657 25102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:34:58.702214 25078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:34:58.702379 25078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "3053577b461f4cfab885ee7072d2e05c"
format_stamp: "Formatted at 2026-08-10 06:34:58 on dist-test-slave-7lbf"
server_key: "3738944eb609a937a0204b1930bd803e"
server_key_iv: "466d9d955b8312659afc069f60bcd8f9"
server_key_version: "encryptionkey@0"
I20260810 06:34:58.702507 25078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:34:58.707753 25078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:34:58.711145 25078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:34:58.711352 25078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:34:58.718710 25078 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:32801
I20260810 06:34:58.718719 25187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:32801 every 8 connection(s)
I20260810 06:34:58.719826 25078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:34:58.720232 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25078
I20260810 06:34:58.720414 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:34:58.720710 22287 external_mini_cluster.cc:1428] Setting key 1d12be649c23831d8a0a61331a97aa14
I20260810 06:34:58.723238 25188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:34:58.726346 25193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:58.722237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53363 (local address 127.21.195.254:32801)
0810 06:34:58.722675 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:58.722691 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:58.722731 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:34:58.723441 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:58.723463 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:58.723791 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:58.724114 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:58.724992 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:58.724997 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:58.725011 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:58.725022 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:58.725080 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:58.725100 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:58.725217 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:58.725317 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 06:34:58.725483 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":120,"threads_started":1}
I20260810 06:34:58.729619 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:34:58.730333 25188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c: Bootstrap starting.
I20260810 06:34:58.733352 25188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c: Neither blocks nor log segments found. Creating new log.
I20260810 06:34:58.733819 25193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:34:58.732085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54553 (local address 127.21.195.254:32801)
0810 06:34:58.732214 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 06:34:58.732219 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:34:58.732405 (+ 186us) server_negotiation.cc:407] Connection header received
0810 06:34:58.732516 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:34:58.732519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:34:58.732560 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:34:58.732646 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:34:58.733325 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:34:58.733328 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:34:58.733331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:34:58.733345 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:34:58.733379 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:34:58.733393 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:34:58.733491 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:34:58.733653 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 06:34:58.733698 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:34:58.734333 25188 log.cc:824] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c: Log is configured to *not* fsync() on all Append() calls
I20260810 06:34:58.736433 25188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c: No bootstrap required, opened a new log
I20260810 06:34:58.740386 25188 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3053577b461f4cfab885ee7072d2e05c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 32801 } }
I20260810 06:34:58.740657 25188 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:34:58.740705 25188 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3053577b461f4cfab885ee7072d2e05c, State: Initialized, Role: FOLLOWER
I20260810 06:34:58.741154 25188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3053577b461f4cfab885ee7072d2e05c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 32801 } }
I20260810 06:34:58.741300 25188 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:34:58.741348 25188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:34:58.741430 25188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:34:58.742462 25188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3053577b461f4cfab885ee7072d2e05c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 32801 } }
I20260810 06:34:58.742806 25188 leader_election.cc:302] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3053577b461f4cfab885ee7072d2e05c; no voters:
I20260810 06:34:58.743108 25188 leader_election.cc:288] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:34:58.743235 25203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:34:58.743474 25203 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [term 1 LEADER]: Becoming Leader. State: Replica: 3053577b461f4cfab885ee7072d2e05c, State: Running, Role: LEADER
I20260810 06:34:58.743834 25203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3053577b461f4cfab885ee7072d2e05c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 32801 } }
I20260810 06:34:58.744411 25188 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:34:58.745641 25209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3053577b461f4cfab885ee7072d2e05c. Latest consensus state: current_term: 1 leader_uuid: "3053577b461f4cfab885ee7072d2e05c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3053577b461f4cfab885ee7072d2e05c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 32801 } } }
I20260810 06:34:58.745786 25209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:58.746209 25220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:34:58.746536 25205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3053577b461f4cfab885ee7072d2e05c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3053577b461f4cfab885ee7072d2e05c" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 32801 } } }
I20260810 06:34:58.746701 25205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c [sys.catalog]: This master's current role is: LEADER
I20260810 06:34:58.750109 25220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:34:58.756377 25220 catalog_manager.cc:1347] Generated new cluster ID: bd6bb71f713a4e5bb2327b4b799af5c2
I20260810 06:34:58.756491 25220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:34:58.781344 25220 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:34:58.781842 25220 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:34:58.791884 25220 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3053577b461f4cfab885ee7072d2e05c: Generated new TSK 0
I20260810 06:34:58.793167 25220 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:34:58.806226 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25078
2026-08-10T06:34:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1566 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:34:58 dist-test-slave-7lbf krb5kdc[25244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:34:58 dist-test-slave-7lbf krb5kdc[25244](info): set up 2 sockets
Aug 10 06:34:58 dist-test-slave-7lbf krb5kdc[25244](info): commencing operation
krb5kdc: starting...
W20260810 06:34:59.966331 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:35:00 dist-test-slave-7lbf krb5kdc[25244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:35:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:35:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:35:00.102439 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39169
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:35157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:39169
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:35:00.226204 25267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:00.226542 25267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:00.226604 25267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:00.230862 25267 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:00.230957 25267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:00.230984 25267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:00.231005 25267 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:00.231025 25267 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:00.237067 25267 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:35157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:39169
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:39169
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:00.238372 25267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:00.239812 25267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:35:00.249931 25267 server_base.cc:1034] running on GCE node
W20260810 06:35:00.249863 25274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:00.249979 25276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:00.249863 25273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:00.250882 25267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:00.252208 25267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:00.253389 25267 hybrid_clock.cc:648] HybridClock initialized: now 1786343700253370 us; error 36 us; skew 500 ppm
Aug 10 06:35:00 dist-test-slave-7lbf krb5kdc[25244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343700, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:00.256567 25267 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:35:00.257721 25267 webserver.cc:460] Webserver started at http://127.21.195.254:43799/ using document root <none> and password file <none>
I20260810 06:35:00.258363 25267 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:00.258441 25267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:00.258657 25267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:00.261044 25267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "ebea62f1ba42469283889674c9c5ca72"
format_stamp: "Formatted at 2026-08-10 06:35:00 on dist-test-slave-7lbf"
server_key: "0eaf39881ab9fdeaf07976c95e309464"
server_key_iv: "9b9dd79de051e9d9127c62a35ef2b824"
server_key_version: "encryptionkey@0"
I20260810 06:35:00.261744 25267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "ebea62f1ba42469283889674c9c5ca72"
format_stamp: "Formatted at 2026-08-10 06:35:00 on dist-test-slave-7lbf"
server_key: "0eaf39881ab9fdeaf07976c95e309464"
server_key_iv: "9b9dd79de051e9d9127c62a35ef2b824"
server_key_version: "encryptionkey@0"
I20260810 06:35:00.266181 25267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:35:00.268894 25285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:00.270509 25267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:35:00.270673 25267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "ebea62f1ba42469283889674c9c5ca72"
format_stamp: "Formatted at 2026-08-10 06:35:00 on dist-test-slave-7lbf"
server_key: "0eaf39881ab9fdeaf07976c95e309464"
server_key_iv: "9b9dd79de051e9d9127c62a35ef2b824"
server_key_version: "encryptionkey@0"
I20260810 06:35:00.270812 25267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:00.290433 25267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:00.293763 25267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:00.293982 25267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:00.301443 25267 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:39169
I20260810 06:35:00.301476 25369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:39169 every 8 connection(s)
I20260810 06:35:00.302609 25267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:35:00.305832 25371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:00.310986 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25267
I20260810 06:35:00.311165 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:35:00.311486 22287 external_mini_cluster.cc:1428] Setting key 248513a23093d7c0da535ce3741abe4e
I20260810 06:35:00.312649 25371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72: Bootstrap starting.
I20260810 06:35:00.315315 25371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72: Neither blocks nor log segments found. Creating new log.
I20260810 06:35:00.316376 25371 log.cc:824] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:00.318931 25371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72: No bootstrap required, opened a new log
Aug 10 06:35:00 dist-test-slave-7lbf krb5kdc[25244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:35:00.323527 25371 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebea62f1ba42469283889674c9c5ca72" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39169 } }
I20260810 06:35:00.323812 25371 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:35:00.323861 25371 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebea62f1ba42469283889674c9c5ca72, State: Initialized, Role: FOLLOWER
I20260810 06:35:00.324378 25371 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebea62f1ba42469283889674c9c5ca72" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39169 } }
I20260810 06:35:00.324574 25371 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:35:00.324653 25371 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:35:00.324770 25371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:00.325944 25371 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebea62f1ba42469283889674c9c5ca72" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39169 } }
I20260810 06:35:00.326386 25371 leader_election.cc:302] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebea62f1ba42469283889674c9c5ca72; no voters:
I20260810 06:35:00.326797 25371 leader_election.cc:288] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:35:00.326921 25380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:35:00.327160 25380 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [term 1 LEADER]: Becoming Leader. State: Replica: ebea62f1ba42469283889674c9c5ca72, State: Running, Role: LEADER
I20260810 06:35:00.327919 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:00.313168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57013 (local address 127.21.195.254:39169)
0810 06:35:00.313705 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:00.313725 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:00.313771 (+ 46us) server_negotiation.cc:407] Connection header received
0810 06:35:00.314529 (+ 758us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:00.314550 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:00.314973 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:00.315324 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:00.316319 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:00.317429 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:00.318637 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:00.319204 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:00.319346 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:00.322447 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:00.322453 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:00.322472 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:00.322509 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:00.324329 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:00.324868 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:00.324876 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:00.324884 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:00.325024 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:00.325323 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:00.325325 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:00.325326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:00.325834 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:00.326005 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:00.326338 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 06:35:00.326737 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":147,"threads_started":1}
I20260810 06:35:00.328150 25371 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:35:00.329172 25380 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebea62f1ba42469283889674c9c5ca72" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39169 } }
I20260810 06:35:00.331404 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:35:00.331543 25381 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebea62f1ba42469283889674c9c5ca72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebea62f1ba42469283889674c9c5ca72" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39169 } } }
I20260810 06:35:00.331673 25381 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:00.331928 25382 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebea62f1ba42469283889674c9c5ca72. Latest consensus state: current_term: 1 leader_uuid: "ebea62f1ba42469283889674c9c5ca72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebea62f1ba42469283889674c9c5ca72" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 39169 } } }
I20260810 06:35:00.332252 25410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:35:00.332309 25382 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:00.335963 25410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:35:00.342876 25410 catalog_manager.cc:1347] Generated new cluster ID: 9cb88acad307433d982fcd681b10e32a
I20260810 06:35:00.343055 25410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:35:00.346843 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:00.333822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35569 (local address 127.21.195.254:39169)
0810 06:35:00.333928 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:00.333933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:00.338138 (+ 4205us) server_negotiation.cc:407] Connection header received
0810 06:35:00.338357 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:00.338361 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:00.338422 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:00.338532 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:00.339447 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:00.340275 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:00.341351 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:00.341766 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:00.341875 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:00.343620 (+ 1745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:00.343623 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:00.343626 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:00.343652 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:00.345041 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:00.345468 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:00.345471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:00.345473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:00.345590 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:00.345853 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:00.345857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:00.345859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:00.346051 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:00.346169 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:00.346419 (+ 250us) server_negotiation.cc:299] Negotiation successful
0810 06:35:00.346545 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 06:35:00.355211 25410 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:35:00.356660 25410 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:35:00.362063 25410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebea62f1ba42469283889674c9c5ca72: Generated new TSK 0
I20260810 06:35:00.363070 25410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:35:00.371778 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25267
2026-08-10T06:35:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1573 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:35:00 dist-test-slave-7lbf krb5kdc[25427](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:35:00 dist-test-slave-7lbf krb5kdc[25427](info): set up 2 sockets
Aug 10 06:35:00 dist-test-slave-7lbf krb5kdc[25427](info): commencing operation
krb5kdc: starting...
W20260810 06:35:01.543954 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:35:01 dist-test-slave-7lbf krb5kdc[25427](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:35:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:35:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:35:01.674983 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44691
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:38727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:44691
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:35:01.799463 25445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:01.799805 25445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:01.799870 25445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:01.804992 25445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:01.805083 25445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:01.805110 25445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:01.805135 25445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:01.805163 25445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:01.811043 25445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:38727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:44691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:44691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:01.812314 25445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:01.813494 25445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:35:01.823124 25457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:01.823192 25445 server_base.cc:1034] running on GCE node
W20260810 06:35:01.823385 25455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:01.823129 25454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:01.824049 25445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:01.825305 25445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:01.826478 25445 hybrid_clock.cc:648] HybridClock initialized: now 1786343701826460 us; error 44 us; skew 500 ppm
Aug 10 06:35:01 dist-test-slave-7lbf krb5kdc[25427](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343701, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:01.829483 25445 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:35:01.830606 25445 webserver.cc:460] Webserver started at http://127.21.195.254:40989/ using document root <none> and password file <none>
I20260810 06:35:01.831241 25445 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:01.831310 25445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:01.831496 25445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:01.833882 25445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "cec21d530b374653b4e5d8faf51a1ed2"
format_stamp: "Formatted at 2026-08-10 06:35:01 on dist-test-slave-7lbf"
server_key: "470f1feb58ba9a306a7f5ffd8907d45a"
server_key_iv: "56a413c30f7b0cb5781ec8b06cbc2122"
server_key_version: "encryptionkey@0"
I20260810 06:35:01.834501 25445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "cec21d530b374653b4e5d8faf51a1ed2"
format_stamp: "Formatted at 2026-08-10 06:35:01 on dist-test-slave-7lbf"
server_key: "470f1feb58ba9a306a7f5ffd8907d45a"
server_key_iv: "56a413c30f7b0cb5781ec8b06cbc2122"
server_key_version: "encryptionkey@0"
I20260810 06:35:01.838937 25445 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260810 06:35:01.841791 25473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:01.843327 25445 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 06:35:01.843457 25445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "cec21d530b374653b4e5d8faf51a1ed2"
format_stamp: "Formatted at 2026-08-10 06:35:01 on dist-test-slave-7lbf"
server_key: "470f1feb58ba9a306a7f5ffd8907d45a"
server_key_iv: "56a413c30f7b0cb5781ec8b06cbc2122"
server_key_version: "encryptionkey@0"
I20260810 06:35:01.843640 25445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:01.867071 25445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:01.870852 25445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:01.871057 25445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:01.878796 25445 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:44691
I20260810 06:35:01.878813 25563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:44691 every 8 connection(s)
I20260810 06:35:01.879911 25445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:35:01.883215 25569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:01.883325 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25445
I20260810 06:35:01.883481 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:35:01.883760 22287 external_mini_cluster.cc:1428] Setting key 6d2535c17290b01a405575d7a32dfe70
I20260810 06:35:01.891417 25569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2: Bootstrap starting.
I20260810 06:35:01.894420 25569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2: Neither blocks nor log segments found. Creating new log.
I20260810 06:35:01.895025 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:01.885369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55951 (local address 127.21.195.254:44691)
0810 06:35:01.885881 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:01.885903 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:01.885954 (+ 51us) server_negotiation.cc:407] Connection header received
0810 06:35:01.886944 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:01.886974 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:01.887503 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:01.887930 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:01.888374 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:01.889927 (+ 1553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:01.890933 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:01.891666 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:01.891832 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:01.892730 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:01.892737 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:01.892755 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:35:01.893300 (+ 545us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:01.893378 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:35:01.893410 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:01.893541 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:01.893680 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 06:35:01.893930 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":157,"threads_started":1}
I20260810 06:35:01.895416 25569 log.cc:824] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:01.897763 25569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2: No bootstrap required, opened a new log
I20260810 06:35:01.898185 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:35:01.902522 25569 raft_consensus.cc:348] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cec21d530b374653b4e5d8faf51a1ed2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44691 } }
I20260810 06:35:01.902807 25569 raft_consensus.cc:374] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:35:01.902859 25569 raft_consensus.cc:729] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cec21d530b374653b4e5d8faf51a1ed2, State: Initialized, Role: FOLLOWER
I20260810 06:35:01.903393 25569 consensus_queue.cc:260] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cec21d530b374653b4e5d8faf51a1ed2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44691 } }
I20260810 06:35:01.903580 25569 raft_consensus.cc:388] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:35:01.903661 25569 raft_consensus.cc:482] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:35:01.903769 25569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:01.904778 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:01.900597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40317 (local address 127.21.195.254:44691)
0810 06:35:01.900733 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:01.900738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:01.900986 (+ 248us) server_negotiation.cc:407] Connection header received
0810 06:35:01.901082 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:01.901085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:01.901135 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:01.901226 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:01.901460 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:01.902226 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:01.903095 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:01.903435 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:01.903558 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:01.904370 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:01.904374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:01.904377 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:35:01.904391 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:01.904422 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:35:01.904436 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:01.904519 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:01.904575 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 06:35:01.904634 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 06:35:01.905023 25569 raft_consensus.cc:504] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cec21d530b374653b4e5d8faf51a1ed2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44691 } }
I20260810 06:35:01.905424 25569 leader_election.cc:302] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cec21d530b374653b4e5d8faf51a1ed2; no voters:
I20260810 06:35:01.905851 25569 leader_election.cc:288] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:35:01.905982 25585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:35:01.906322 25585 raft_consensus.cc:686] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [term 1 LEADER]: Becoming Leader. State: Replica: cec21d530b374653b4e5d8faf51a1ed2, State: Running, Role: LEADER
I20260810 06:35:01.906714 25585 consensus_queue.cc:237] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cec21d530b374653b4e5d8faf51a1ed2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44691 } }
I20260810 06:35:01.907387 25569 sys_catalog.cc:564] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:35:01.908691 25589 sys_catalog.cc:455] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cec21d530b374653b4e5d8faf51a1ed2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cec21d530b374653b4e5d8faf51a1ed2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44691 } } }
I20260810 06:35:01.908727 25586 sys_catalog.cc:455] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cec21d530b374653b4e5d8faf51a1ed2. Latest consensus state: current_term: 1 leader_uuid: "cec21d530b374653b4e5d8faf51a1ed2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cec21d530b374653b4e5d8faf51a1ed2" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 44691 } } }
I20260810 06:35:01.908828 25589 sys_catalog.cc:458] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:01.908833 25586 sys_catalog.cc:458] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:01.909327 25600 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:35:01.913020 25600 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:35:01.919064 25600 catalog_manager.cc:1347] Generated new cluster ID: f0c33cd3af364a14aaa58acbd51c130d
I20260810 06:35:01.919160 25600 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:35:01.924897 25600 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:35:01.925982 25600 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:35:01.935323 25600 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cec21d530b374653b4e5d8faf51a1ed2: Generated new TSK 0
I20260810 06:35:01.936206 25600 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:35:01.942142 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25445
2026-08-10T06:35:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1564 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:35:02 dist-test-slave-7lbf krb5kdc[25619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:35:02 dist-test-slave-7lbf krb5kdc[25619](info): set up 2 sockets
Aug 10 06:35:02 dist-test-slave-7lbf krb5kdc[25619](info): commencing operation
krb5kdc: starting...
W20260810 06:35:03.117364 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:35:03 dist-test-slave-7lbf krb5kdc[25619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:35:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:35:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:35:03.252305 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:38253
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:38253
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:35:03.377139 25639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:03.377506 25639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:03.377606 25639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:03.381901 25639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:03.381990 25639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:03.382017 25639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:03.382040 25639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:03.382059 25639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:03.387967 25639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:38253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:38253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:03.389328 25639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:03.390615 25639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:35:03.400118 25647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:03.400167 25648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:03.400292 25652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:03.400413 25639 server_base.cc:1034] running on GCE node
I20260810 06:35:03.401091 25639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:03.402459 25639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:03.403638 25639 hybrid_clock.cc:648] HybridClock initialized: now 1786343703403617 us; error 36 us; skew 500 ppm
Aug 10 06:35:03 dist-test-slave-7lbf krb5kdc[25619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343703, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:03.406720 25639 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:35:03.407793 25639 webserver.cc:460] Webserver started at http://127.21.195.254:33405/ using document root <none> and password file <none>
I20260810 06:35:03.408421 25639 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:03.408496 25639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:03.408708 25639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:03.411154 25639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "2ba5cd20f00d43b0be5363a721c01aac"
format_stamp: "Formatted at 2026-08-10 06:35:03 on dist-test-slave-7lbf"
server_key: "d26de01949fdec0b5ed9d68ccb62e0f5"
server_key_iv: "f1e78b8ec4ba9883090012f0dae4a28b"
server_key_version: "encryptionkey@0"
I20260810 06:35:03.411798 25639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "2ba5cd20f00d43b0be5363a721c01aac"
format_stamp: "Formatted at 2026-08-10 06:35:03 on dist-test-slave-7lbf"
server_key: "d26de01949fdec0b5ed9d68ccb62e0f5"
server_key_iv: "f1e78b8ec4ba9883090012f0dae4a28b"
server_key_version: "encryptionkey@0"
I20260810 06:35:03.416044 25639 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:35:03.418936 25668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:03.420423 25639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:35:03.420570 25639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "2ba5cd20f00d43b0be5363a721c01aac"
format_stamp: "Formatted at 2026-08-10 06:35:03 on dist-test-slave-7lbf"
server_key: "d26de01949fdec0b5ed9d68ccb62e0f5"
server_key_iv: "f1e78b8ec4ba9883090012f0dae4a28b"
server_key_version: "encryptionkey@0"
I20260810 06:35:03.420692 25639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:03.425915 25639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:03.429225 25639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:03.429435 25639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:03.437084 25639 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:38253
I20260810 06:35:03.437103 25773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:38253 every 8 connection(s)
I20260810 06:35:03.438252 25639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:35:03.440529 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25639
I20260810 06:35:03.440654 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:35:03.440930 22287 external_mini_cluster.cc:1428] Setting key f847ca3363d7c62174f3fca6e148cadf
I20260810 06:35:03.442149 25774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:03.446722 25777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:03.442548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60495 (local address 127.21.195.254:38253)
0810 06:35:03.443026 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:03.443044 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:03.443084 (+ 40us) server_negotiation.cc:407] Connection header received
0810 06:35:03.443764 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:03.443783 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:03.444114 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:03.444462 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:03.445368 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:03.445373 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:03.445389 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:35:03.445401 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:03.445464 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:35:03.445486 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:03.445670 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:03.445749 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 06:35:03.445931 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":134,"threads_started":1}
I20260810 06:35:03.449018 25774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac: Bootstrap starting.
I20260810 06:35:03.449756 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:35:03.451850 25774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac: Neither blocks nor log segments found. Creating new log.
I20260810 06:35:03.452720 25774 log.cc:824] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:03.453687 25777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:03.451932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51519 (local address 127.21.195.254:38253)
0810 06:35:03.452079 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:03.452084 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:03.452267 (+ 183us) server_negotiation.cc:407] Connection header received
0810 06:35:03.452390 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:03.452393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:03.452435 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:03.452504 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:03.453276 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:03.453279 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:03.453282 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 06:35:03.453295 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:03.453325 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 06:35:03.453335 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:03.453409 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:03.453497 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 06:35:03.453562 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 06:35:03.455121 25774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac: No bootstrap required, opened a new log
I20260810 06:35:03.459273 25774 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba5cd20f00d43b0be5363a721c01aac" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38253 } }
I20260810 06:35:03.459568 25774 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 06:35:03.459623 25774 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ba5cd20f00d43b0be5363a721c01aac, State: Initialized, Role: FOLLOWER
I20260810 06:35:03.460127 25774 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba5cd20f00d43b0be5363a721c01aac" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38253 } }
I20260810 06:35:03.460310 25774 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 06:35:03.460397 25774 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 06:35:03.460506 25774 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:03.461542 25774 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba5cd20f00d43b0be5363a721c01aac" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38253 } }
I20260810 06:35:03.461922 25774 leader_election.cc:302] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2ba5cd20f00d43b0be5363a721c01aac; no voters:
I20260810 06:35:03.462294 25774 leader_election.cc:288] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 06:35:03.462402 25787 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:35:03.462613 25787 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [term 1 LEADER]: Becoming Leader. State: Replica: 2ba5cd20f00d43b0be5363a721c01aac, State: Running, Role: LEADER
I20260810 06:35:03.462941 25787 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba5cd20f00d43b0be5363a721c01aac" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38253 } }
I20260810 06:35:03.463625 25774 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:35:03.464751 25790 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ba5cd20f00d43b0be5363a721c01aac. Latest consensus state: current_term: 1 leader_uuid: "2ba5cd20f00d43b0be5363a721c01aac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba5cd20f00d43b0be5363a721c01aac" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38253 } } }
I20260810 06:35:03.464906 25790 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:03.465180 25789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2ba5cd20f00d43b0be5363a721c01aac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2ba5cd20f00d43b0be5363a721c01aac" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 38253 } } }
I20260810 06:35:03.465281 25789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:03.465415 25802 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:35:03.468664 25802 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:35:03.475154 25802 catalog_manager.cc:1347] Generated new cluster ID: e98ae4c13f90495fa1c834d6a17e900a
I20260810 06:35:03.475250 25802 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:35:03.486020 25802 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:35:03.486446 25802 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:35:03.493736 25802 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2ba5cd20f00d43b0be5363a721c01aac: Generated new TSK 0
I20260810 06:35:03.494596 25802 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 06:35:03.507941 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25639
2026-08-10T06:35:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1574 ms)
[----------] 18 tests from AuthTokenIssuingTest (28569 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:35:03 dist-test-slave-7lbf krb5kdc[25823](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:35:03 dist-test-slave-7lbf krb5kdc[25823](info): set up 2 sockets
Aug 10 06:35:03 dist-test-slave-7lbf krb5kdc[25823](info): commencing operation
krb5kdc: starting...
W20260810 06:35:04.711670 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:35:04 dist-test-slave-7lbf krb5kdc[25823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:35:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:35:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:35:04.850925 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:41391
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:41391,127.21.195.253:40039,127.21.195.252:42855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:35:04.974298 25844 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:35:04.974674 25844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:04.974715 25844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:04.974784 25844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:04.979101 25844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:04.979187 25844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:04.979215 25844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:04.979238 25844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:04.979259 25844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:04.985800 25844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:41391,127.21.195.253:40039,127.21.195.252:42855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:41391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:04.987524 25844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:04.989148 25844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:35:05.000959 25853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:05.000946 25860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:05.000952 25856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:05.001183 25844 server_base.cc:1034] running on GCE node
I20260810 06:35:05.001909 25844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:05.003235 25844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:05.004421 25844 hybrid_clock.cc:648] HybridClock initialized: now 1786343705004401 us; error 39 us; skew 500 ppm
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:05.007534 25844 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:35:05.008639 25844 webserver.cc:460] Webserver started at http://127.21.195.254:35217/ using document root <none> and password file <none>
I20260810 06:35:05.009258 25844 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:05.009331 25844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:05.009608 25844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:05.012007 25844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "400730fa49014be39013f993706a96a5"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "6aa0e641e8f454db282ccc36dd3a67f6"
server_key_iv: "c997aa527063ad1a37e02f1477a4d457"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.012666 25844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "400730fa49014be39013f993706a96a5"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "6aa0e641e8f454db282ccc36dd3a67f6"
server_key_iv: "c997aa527063ad1a37e02f1477a4d457"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.017038 25844 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:35:05.019949 25873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:05.021363 25844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260810 06:35:05.021579 25844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "400730fa49014be39013f993706a96a5"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "6aa0e641e8f454db282ccc36dd3a67f6"
server_key_iv: "c997aa527063ad1a37e02f1477a4d457"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.021716 25844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:05.034657 25844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:05.038200 25844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:05.038422 25844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:05.046180 25844 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:41391
I20260810 06:35:05.046445 25960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:41391 every 8 connection(s)
I20260810 06:35:05.047322 25844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:35:05.049368 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25844
I20260810 06:35:05.049508 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:35:05.049889 22287 external_mini_cluster.cc:1428] Setting key 408acc6bc2de7ef10206e61cf7104ddc
I20260810 06:35:05.051173 25961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:05.055873 25961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.195.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.253@KRBTEST.COM" created.
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:35:05.073055 25965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.058669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58152 (local address 127.21.195.254:41391)
0810 06:35:05.059161 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.059180 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.059480 (+ 300us) server_negotiation.cc:407] Connection header received
0810 06:35:05.060609 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.060614 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.060824 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.061042 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.061972 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.063041 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.064412 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.064852 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.065035 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.067753 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.067761 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.067774 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.067800 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.069455 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.070140 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.070147 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.070148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.070279 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.070683 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.070689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.070691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.071153 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.071269 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.071836 (+ 567us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.072141 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":333,"thread_start_us":145,"threads_started":1}
I20260810 06:35:05.073091 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.058670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41391 (local address 127.0.0.1:58152)
0810 06:35:05.059305 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.059361 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.060268 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.061025 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.061031 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.061495 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.061813 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.061829 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.063157 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.063161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.064252 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.064265 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.065081 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.065086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.065191 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.065843 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.065862 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.067556 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.069612 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.069624 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.069640 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.069998 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.070393 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.070397 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.070399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.070586 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.071281 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.071290 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.071494 (+ 204us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.071723 (+ 229us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.072228 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"mutex_wait_us":103,"spinlock_wait_cycles":28032,"thread_start_us":174,"threads_started":1}
I20260810 06:35:05.075866 25961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:05.076630 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.076369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49740)
0810 06:35:05.076482 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.076561 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 06:35:05.076860 25878 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
I20260810 06:35:05.077826 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.077636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49748)
0810 06:35:05.077715 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.077760 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260810 06:35:05.077965 25961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:40039: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab.
Entry for principal kudu/127.21.195.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab.
I20260810 06:35:05.080840 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.253:40039
--webserver_interface=127.21.195.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab
--principal=kudu/127.21.195.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:41391,127.21.195.253:40039,127.21.195.252:42855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:35:05.127277 25961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } attempt: 1
I20260810 06:35:05.128376 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.127966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49760)
0810 06:35:05.128165 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.128267 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 06:35:05.129187 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.128948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49774)
0810 06:35:05.129051 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.129110 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 06:35:05.129320 25961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:40039: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
I20260810 06:35:05.197556 25961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } attempt: 2
I20260810 06:35:05.198477 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.198104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49778)
0810 06:35:05.198286 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.198369 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 06:35:05.199368 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.199111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49782)
0810 06:35:05.199224 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.199287 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 06:35:05.199540 25961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:40039: Network error: Client connection negotiation failed: client connection to 127.21.195.253:40039: connect: Connection refused (error 111)
W20260810 06:35:05.207296 25969 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:35:05.207651 25969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:05.207685 25969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:05.207754 25969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:05.212224 25969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:05.212327 25969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:05.212345 25969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:05.212361 25969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:05.212376 25969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:05.218269 25969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:41391,127.21.195.253:40039,127.21.195.252:42855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab
--principal=kudu/127.21.195.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.253:40039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.195.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:05.219525 25969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:05.220708 25969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 06:35:05.230736 25969 server_base.cc:1034] running on GCE node
W20260810 06:35:05.230682 25981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:05.230687 25980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:05.230687 25985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:05.231581 25969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:05.232923 25969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:05.234097 25969 hybrid_clock.cc:648] HybridClock initialized: now 1786343705234071 us; error 42 us; skew 500 ppm
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:05.237195 25969 init.cc:377] Logged in from keytab as kudu/127.21.195.253@KRBTEST.COM (short username kudu)
I20260810 06:35:05.238294 25969 webserver.cc:460] Webserver started at http://127.21.195.253:42377/ using document root <none> and password file <none>
I20260810 06:35:05.238883 25969 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:05.238947 25969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:05.239153 25969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:05.241405 25969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/data/instance:
uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "5798d4aca3bfdc771b9b736b7a694ffb"
server_key_iv: "aa32f1598db8ad4ca2ff5430729888bf"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.242079 25969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/wal/instance:
uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "5798d4aca3bfdc771b9b736b7a694ffb"
server_key_iv: "aa32f1598db8ad4ca2ff5430729888bf"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.246723 25969 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 06:35:05.249603 25997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:05.251147 25969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:35:05.251289 25969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/wal
uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "5798d4aca3bfdc771b9b736b7a694ffb"
server_key_iv: "aa32f1598db8ad4ca2ff5430729888bf"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.251406 25969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:05.269717 25969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:05.273039 25969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:05.273227 25969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:05.280680 25969 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.253:40039
I20260810 06:35:05.281035 26070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.253:40039 every 8 connection(s)
I20260810 06:35:05.282105 25969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
I20260810 06:35:05.285583 26073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:05.289439 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 25969
I20260810 06:35:05.289619 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-1/wal/instance
I20260810 06:35:05.290004 22287 external_mini_cluster.cc:1428] Setting key 7db2fe868995f65d31b15941504365d1
I20260810 06:35:05.290696 25961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } attempt: 3
I20260810 06:35:05.290450 26073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.195.252@KRBTEST.COM; defaulting to no policy
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.252@KRBTEST.COM" created.
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:35:05.305200 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.291265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49798)
0810 06:35:05.291507 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.291524 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.291650 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.294270 (+ 2620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.294274 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.294504 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.294656 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.294666 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.296593 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.296598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.297459 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.297473 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.298422 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.298428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.298571 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.299211 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.299225 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.300728 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.302821 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.302826 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.302828 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.303134 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.303592 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.303597 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.303599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.303740 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.304502 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.304506 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.304635 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.304763 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.304966 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149}
I20260810 06:35:05.306792 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.292062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49798 (local address 127.21.195.253:40039)
0810 06:35:05.292628 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.292645 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.292684 (+ 39us) server_negotiation.cc:407] Connection header received
0810 06:35:05.293677 (+ 993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.293707 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.294048 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.294874 (+ 826us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.295387 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.296457 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.297620 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.298248 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.298441 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.300885 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.300891 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.300904 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.300928 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.302667 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.303275 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.303282 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.303291 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.303468 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.303859 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.303863 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.303865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.304398 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.304541 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.304977 (+ 436us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.305613 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":418,"spinlock_wait_cycles":6272,"thread_start_us":196,"threads_started":1}
I20260810 06:35:05.308223 25965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.293054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58168 (local address 127.21.195.254:41391)
0810 06:35:05.293187 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.293192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.293724 (+ 532us) server_negotiation.cc:407] Connection header received
0810 06:35:05.294233 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.294236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.294302 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.294387 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.295748 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.296536 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.297961 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.298974 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.299085 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.304122 (+ 5037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.304126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.304128 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.304158 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.305905 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.306533 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.306537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.306539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.306633 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.306973 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.306977 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.306980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.307259 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.307360 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.307903 (+ 543us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.308051 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 06:35:05.309214 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.292967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41391 (local address 127.0.0.1:58168)
0810 06:35:05.293540 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.293605 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.293985 (+ 380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.294475 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.294487 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.294976 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.295596 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.295609 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.296676 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.296679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.297837 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.297848 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.299796 (+ 1948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.299808 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.299956 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.300548 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.300568 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.303969 (+ 3401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.306044 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.306056 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.306065 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.306404 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.306726 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.306729 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.306732 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.306837 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.307444 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.307451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.307601 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.307762 (+ 161us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.309012 (+ 1250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":32,"spinlock_wait_cycles":2944,"thread_start_us":99,"threads_started":1}
I20260810 06:35:05.309584 25961 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:05.310437 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.310150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36046)
0810 06:35:05.310295 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.310358 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 06:35:05.310845 26073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:05.311300 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.311034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36050)
0810 06:35:05.311181 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.311236 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260810 06:35:05.311467 25961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:42855: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:35:05.320834 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.311514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49814 (local address 127.21.195.253:40039)
0810 06:35:05.311615 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.311620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.311684 (+ 64us) server_negotiation.cc:407] Connection header received
0810 06:35:05.311817 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.311821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.311871 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.311944 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.312351 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.313158 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.314025 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.314402 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.314513 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.317568 (+ 3055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.317572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.317574 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.317599 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.318916 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.319434 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.319437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.319438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.319513 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.319889 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.319892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.319893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.320131 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.320214 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.320528 (+ 314us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.320708 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":36}
I20260810 06:35:05.320816 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.311375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49814)
0810 06:35:05.311619 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.311636 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.311728 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.311960 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.311962 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.312120 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.312230 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.312235 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.313281 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.313283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.313902 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.313912 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.314516 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.314519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.314603 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.315175 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.315188 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.317396 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.319033 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.319036 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.319038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.319296 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.319584 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.319586 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.319588 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.319794 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.320214 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.320216 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.320362 (+ 146us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.320482 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.320638 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab.
Entry for principal kudu/127.21.195.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab.
I20260810 06:35:05.321797 26073 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:05.322609 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.322321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36054)
0810 06:35:05.322454 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.322543 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 06:35:05.322949 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.252:42855
--webserver_interface=127.21.195.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab
--principal=kudu/127.21.195.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:36847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:41391,127.21.195.253:40039,127.21.195.252:42855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:35:05.323206 25998 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
I20260810 06:35:05.324158 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.323948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36058)
0810 06:35:05.324057 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.324101 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:35:05.324294 26073 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:42855: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
I20260810 06:35:05.342644 25961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } attempt: 1
I20260810 06:35:05.343609 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.343297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36066)
0810 06:35:05.343450 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.343522 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 06:35:05.344408 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.344171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36068)
0810 06:35:05.344289 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.344341 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:35:05.344571 25961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:42855: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
I20260810 06:35:05.373654 26073 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } attempt: 1
I20260810 06:35:05.374609 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.374285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36070)
0810 06:35:05.374451 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.374520 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260810 06:35:05.375334 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.375103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36078)
0810 06:35:05.375213 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.375262 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:35:05.375458 26073 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:42855: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
I20260810 06:35:05.419775 25961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } attempt: 2
I20260810 06:35:05.420769 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.420432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36080)
0810 06:35:05.420602 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.420675 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260810 06:35:05.421605 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.421337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36086)
0810 06:35:05.421450 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.421502 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 06:35:05.421765 25961 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:42855: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
I20260810 06:35:05.443607 26073 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } attempt: 2
I20260810 06:35:05.444581 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.444252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36092)
0810 06:35:05.444429 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.444498 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260810 06:35:05.445422 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.445148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36098)
0810 06:35:05.445269 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.445332 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 06:35:05.445590 26073 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:42855: Network error: Client connection negotiation failed: client connection to 127.21.195.252:42855: connect: Connection refused (error 111)
W20260810 06:35:05.449281 26083 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:35:05.449661 26083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:05.449697 26083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:05.449743 26083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:05.454083 26083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:05.454154 26083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:05.454173 26083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:05.454190 26083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:05.454205 26083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:05.460125 26083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:36847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:41391,127.21.195.253:40039,127.21.195.252:42855
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab
--principal=kudu/127.21.195.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.252:42855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.195.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:05.461439 26083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:05.462661 26083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:35:05.472208 26101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:05.472211 26095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:05.472277 26083 server_base.cc:1034] running on GCE node
W20260810 06:35:05.472208 26096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:05.473155 26083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:05.474455 26083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:05.475608 26083 hybrid_clock.cc:648] HybridClock initialized: now 1786343705475582 us; error 45 us; skew 500 ppm
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:05.478675 26083 init.cc:377] Logged in from keytab as kudu/127.21.195.252@KRBTEST.COM (short username kudu)
I20260810 06:35:05.479795 26083 webserver.cc:460] Webserver started at http://127.21.195.252:36929/ using document root <none> and password file <none>
I20260810 06:35:05.480458 26083 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:05.480563 26083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:05.480810 26083 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:05.483269 26083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/data/instance:
uuid: "5e92cb9ed86e44c5b2a345a99d705b20"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "b4965dba9a096848f2b323c6ae5833bd"
server_key_iv: "bd2811522e324619c23827e2c9ee53f2"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.483944 26083 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/wal/instance:
uuid: "5e92cb9ed86e44c5b2a345a99d705b20"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "b4965dba9a096848f2b323c6ae5833bd"
server_key_iv: "bd2811522e324619c23827e2c9ee53f2"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.488406 26083 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260810 06:35:05.491393 26113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:05.492839 26083 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260810 06:35:05.492991 26083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/wal
uuid: "5e92cb9ed86e44c5b2a345a99d705b20"
format_stamp: "Formatted at 2026-08-10 06:35:05 on dist-test-slave-7lbf"
server_key: "b4965dba9a096848f2b323c6ae5833bd"
server_key_iv: "bd2811522e324619c23827e2c9ee53f2"
server_key_version: "encryptionkey@0"
I20260810 06:35:05.493116 26083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:05.507346 26083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:05.510885 26083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:05.511099 26083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:05.518884 26083 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.252:42855
I20260810 06:35:05.519217 26207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.252:42855 every 8 connection(s)
I20260810 06:35:05.520077 26083 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
I20260810 06:35:05.520920 25961 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } attempt: 3
I20260810 06:35:05.521489 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 26083
I20260810 06:35:05.521643 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786343407647307-22287-0/minicluster-data/master-2/wal/instance
I20260810 06:35:05.521942 22287 external_mini_cluster.cc:1428] Setting key 9ebc7790b0234262d89909ec84721997
I20260810 06:35:05.523833 26208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:05.528864 26208 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
I20260810 06:35:05.536152 25966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.521502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36100)
0810 06:35:05.521762 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.521779 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.521888 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.525243 (+ 3355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.525247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.525468 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.525636 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.525645 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.527731 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.527736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.528280 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.528290 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.529217 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.529221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.529304 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.529881 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.529898 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.531355 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.534058 (+ 2703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.534062 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.534064 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.534326 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.534687 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.534691 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.534693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.534790 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.535596 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.535599 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.535708 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.535812 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.535970 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260810 06:35:05.536753 26073 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } attempt: 3
I20260810 06:35:05.537603 26213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.523206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36102 (local address 127.21.195.252:42855)
0810 06:35:05.523469 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.523476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.523488 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:35:05.524088 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.524118 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.524633 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.525111 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.526008 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.527528 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.528702 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.529084 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.529235 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.532627 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.532631 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.532634 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.532659 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.534175 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.534636 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.534640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.534641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.534718 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.534986 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.534990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.534992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.535458 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.535705 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.536054 (+ 349us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.536368 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":722,"server-negotiator.queue_time_us":200,"spinlock_wait_cycles":8704,"thread_start_us":83,"threads_started":1}
I20260810 06:35:05.537619 26212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.522746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36100 (local address 127.21.195.252:42855)
0810 06:35:05.523221 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.523238 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.523277 (+ 39us) server_negotiation.cc:407] Connection header received
0810 06:35:05.524088 (+ 811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.524118 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.524633 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.525111 (+ 478us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.525793 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.527528 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.528408 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.529057 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.529596 (+ 539us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.531587 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.531594 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.531611 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.531643 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.533919 (+ 2276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.534435 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.534439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.534445 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.534588 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.534910 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.534914 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.534915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.535460 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.535628 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.535989 (+ 361us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.536425 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":402,"server-negotiator.queue_time_us":323,"spinlock_wait_cycles":17280,"thread_start_us":146,"threads_started":1}
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
I20260810 06:35:05.544283 25965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.531298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58182 (local address 127.21.195.254:41391)
0810 06:35:05.531729 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.531734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.531859 (+ 125us) server_negotiation.cc:407] Connection header received
0810 06:35:05.532063 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.532066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.532110 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.532174 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.532948 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.533609 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.534549 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.534883 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.534978 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.539987 (+ 5009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.539991 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.539994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.540042 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.542077 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.542641 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.542645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.542647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.542739 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.543062 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.543066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.543068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.543327 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.543401 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.543984 (+ 583us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.544119 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340}
I20260810 06:35:05.544306 25961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5: Bootstrap starting.
I20260810 06:35:05.544298 26214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.531182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:41391 (local address 127.0.0.1:58182)
0810 06:35:05.531710 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.531767 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.531959 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.532229 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.532235 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.532622 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.532799 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.532809 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.533715 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.533719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.534422 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.534433 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.535007 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.535011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.535134 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.536506 (+ 1372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.536521 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.539841 (+ 3320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.542199 (+ 2358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.542209 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.542217 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.542520 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.542868 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.542871 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.542873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.542963 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.543561 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.543568 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.543705 (+ 137us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.543904 (+ 199us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.544106 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":130,"threads_started":1}
I20260810 06:35:05.546139 26208 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:05.547650 26078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.537244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36114)
0810 06:35:05.537374 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.537390 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.537478 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.538248 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.538253 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.538438 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.538560 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.538568 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.539477 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.539481 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.540218 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.540233 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.541403 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.541408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.541506 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.541952 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.541968 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.543454 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.546000 (+ 2546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.546004 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.546006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.546286 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.546620 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.546624 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.546626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.546728 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.547195 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.547199 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.547311 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.547395 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.547522 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:35:05.548046 25961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5: Neither blocks nor log segments found. Creating new log.
I20260810 06:35:05.548205 26212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.537325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36114 (local address 127.21.195.252:42855)
0810 06:35:05.538016 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.538021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.538032 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:35:05.538065 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.538068 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.538108 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.538190 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.538685 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.539353 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.540923 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.541259 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.541772 (+ 513us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.543610 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.543614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.543617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.543642 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.545869 (+ 2227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.546418 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.546421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.546423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.546506 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.546847 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.546864 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.546866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.547077 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.547828 (+ 751us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.547920 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.548042 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":148,"threads_started":1}
I20260810 06:35:05.549117 25961 log.cc:824] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:05.551908 25961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5: No bootstrap required, opened a new log
I20260810 06:35:05.551996 26073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7: Bootstrap starting.
I20260810 06:35:05.552606 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.540614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58194 (local address 127.21.195.254:41391)
0810 06:35:05.540954 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.540968 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.540980 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:35:05.541012 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.541015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.541056 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.542479 (+ 1423us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.542612 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.543412 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.545051 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.545535 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.547269 (+ 1734us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.548420 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.548424 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.548427 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.548454 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.550186 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.550725 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.550728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.550730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.550813 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.551120 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.551123 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.551125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.551336 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.552195 (+ 859us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.552275 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.552418 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":134,"threads_started":1}
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:35:05.555236 26073 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7: Neither blocks nor log segments found. Creating new log.
I20260810 06:35:05.556209 26073 log.cc:824] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:05.557687 25961 raft_consensus.cc:348] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } }
I20260810 06:35:05.557979 25961 raft_consensus.cc:729] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 400730fa49014be39013f993706a96a5, State: Initialized, Role: FOLLOWER
I20260810 06:35:05.558344 25961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } }
I20260810 06:35:05.558694 26073 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7: No bootstrap required, opened a new log
I20260810 06:35:05.558733 26214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.546657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:40039 (local address 127.0.0.1:49822)
0810 06:35:05.549747 (+ 3090us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.549762 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.549890 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.550200 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.550202 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.550384 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.550541 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.550550 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.551515 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.551518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.552289 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.552300 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.552958 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.552962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.553063 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.553568 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.553584 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.555059 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.557014 (+ 1955us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.557018 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.557020 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.557262 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.557634 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.557637 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.557639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.557733 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.558202 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.558205 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.558312 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.558416 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.558566 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3013}
I20260810 06:35:05.559322 26076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.546743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49822 (local address 127.21.195.253:40039)
0810 06:35:05.546871 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.546876 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.549826 (+ 2950us) server_negotiation.cc:407] Connection header received
0810 06:35:05.549979 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.549982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.550025 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.550071 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.550673 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.551372 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.552423 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.552732 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.552805 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.555183 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.555187 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.555190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.555217 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.556884 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.557381 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.557385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.557387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.557474 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.557851 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.557854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.557856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.558064 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.558154 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.559062 (+ 908us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.559184 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:35:05.559942 25961 sys_catalog.cc:564] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:35:05.560000 26208 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343704, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:35:05.563445 26073 raft_consensus.cc:348] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } }
I20260810 06:35:05.563714 26073 raft_consensus.cc:729] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb6930ad1fd4867b3d20cd1ef99e3d7, State: Initialized, Role: FOLLOWER
I20260810 06:35:05.564118 26073 consensus_queue.cc:260] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } }
Aug 10 06:35:05 dist-test-slave-7lbf krb5kdc[25823](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343705, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
I20260810 06:35:05.566159 26073 sys_catalog.cc:564] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:35:05.566979 26246 sys_catalog.cc:455] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.567126 26246 sys_catalog.cc:458] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:05.569269 26212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.560674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36124 (local address 127.21.195.252:42855)
0810 06:35:05.560782 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.560787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.561009 (+ 222us) server_negotiation.cc:407] Connection header received
0810 06:35:05.561034 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.561036 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.561071 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.561125 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.561633 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.562373 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.563325 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.563610 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.563702 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.566012 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.566015 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.566018 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.566039 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.567565 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.568063 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.568066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.568068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.568148 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.568387 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.568390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.568392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.568594 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.568664 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.568976 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.569108 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 06:35:05.569723 26214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.560485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:42855 (local address 127.0.0.1:36124)
0810 06:35:05.560849 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:05.560862 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:05.560940 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:05.561212 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:05.561215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:05.561393 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:05.561480 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.561486 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.562486 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.562489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.563207 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:05.563217 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.563825 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.563828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:05.563902 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.564349 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:05.564363 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:05.565885 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:05.567690 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.567694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.567696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.567959 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.568236 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:05.568239 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:05.568241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:05.568311 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:05.568722 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:05.568724 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:05.568809 (+ 85us) client_negotiation.cc:769] Sending connection context
0810 06:35:05.569411 (+ 602us) client_negotiation.cc:240] Negotiation successful
0810 06:35:05.569578 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312}
I20260810 06:35:05.565900 25844 master_runner.cc:186] Error getting master registration for 127.21.195.253:40039: OK, instance_id { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" instance_seqno: 1786343705278559 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:35:05.569890 25844 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:35:05.572258 26218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.554080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49830 (local address 127.21.195.253:40039)
0810 06:35:05.555397 (+ 1317us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.555407 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.555421 (+ 14us) server_negotiation.cc:407] Connection header received
0810 06:35:05.555455 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.555458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.555503 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.555640 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.557754 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.558543 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.560306 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.560652 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.560732 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.563995 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.563999 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.564002 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.564029 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.566477 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.570658 (+ 4181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.570662 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.570664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.570783 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.571128 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.571132 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.571134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.571348 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.571544 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.571937 (+ 393us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.572074 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1243,"thread_start_us":147,"threads_started":1}
W20260810 06:35:05.572826 26268 catalog_manager.cc:1558] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:35:05.572911 26268 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:35:05.573153 26208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20: Bootstrap starting.
I20260810 06:35:05.576200 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:35:05.576220 26208 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20: Neither blocks nor log segments found. Creating new log.
I20260810 06:35:05.573740 25969 master_runner.cc:186] Error getting master registration for 127.21.195.252:42855: OK, instance_id { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" instance_seqno: 1786343705516616 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:35:05.577004 25969 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:35:05.577152 26208 log.cc:824] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:05.577255 26223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.577428 26223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:05.577888 25919 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "400730fa49014be39013f993706a96a5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58194
I20260810 06:35:05.578230 25919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 06:35:05.578362 25919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:05.579473 25919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } }
I20260810 06:35:05.580437 25919 leader_election.cc:288] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [CANDIDATE]: Term 1 election: Requested vote from peers adb6930ad1fd4867b3d20cd1ef99e3d7 (127.21.195.253:40039), 5e92cb9ed86e44c5b2a345a99d705b20 (127.21.195.252:42855)
I20260810 06:35:05.581005 26033 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "400730fa49014be39013f993706a96a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7"
I20260810 06:35:05.581277 26033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:05.583263 26033 raft_consensus.cc:2454] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 400730fa49014be39013f993706a96a5 in term 1.
I20260810 06:35:05.583770 25878 leader_election.cc:302] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 400730fa49014be39013f993706a96a5, adb6930ad1fd4867b3d20cd1ef99e3d7; no voters:
W20260810 06:35:05.583786 26244 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:35:05.583914 26244 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:35:05.584064 26223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:35:05.584283 26223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [term 1 LEADER]: Becoming Leader. State: Replica: 400730fa49014be39013f993706a96a5, State: Running, Role: LEADER
I20260810 06:35:05.584684 26223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } }
I20260810 06:35:05.587139 26282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 400730fa49014be39013f993706a96a5. Latest consensus state: current_term: 1 leader_uuid: "400730fa49014be39013f993706a96a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.587277 26282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:05.587698 26284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:35:05.588191 26208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20: No bootstrap required, opened a new log
I20260810 06:35:05.588708 26284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:35:05.592724 26208 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } }
I20260810 06:35:05.593031 26208 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e92cb9ed86e44c5b2a345a99d705b20, State: Initialized, Role: FOLLOWER
I20260810 06:35:05.593406 26208 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } }
I20260810 06:35:05.595520 26208 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:35:05.595615 26162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "400730fa49014be39013f993706a96a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5e92cb9ed86e44c5b2a345a99d705b20"
I20260810 06:35:05.595906 26162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:05.597494 26162 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 400730fa49014be39013f993706a96a5 in term 1.
I20260810 06:35:05.597656 26287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.597792 26287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:05.598348 26033 raft_consensus.cc:1261] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [term 1 FOLLOWER]: Refusing update from remote peer 400730fa49014be39013f993706a96a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:35:05.599052 26282 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:35:05.599049 26161 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [term 1 FOLLOWER]: Refusing update from remote peer 400730fa49014be39013f993706a96a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:35:05.601907 26282 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:35:05.605027 26212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.583930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36138 (local address 127.21.195.252:42855)
0810 06:35:05.584060 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.584065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.585896 (+ 1831us) server_negotiation.cc:407] Connection header received
0810 06:35:05.586040 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.586043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.586100 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.586188 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.587945 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.588664 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.592748 (+ 4084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.593073 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.593157 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.600523 (+ 7366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.600528 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.600531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.600569 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.602365 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.602919 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.602923 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.602926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.603025 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.603341 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.603345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.603346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.603584 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.603727 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.604726 (+ 999us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.604876 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 06:35:05.609135 26246 sys_catalog.cc:455] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 400730fa49014be39013f993706a96a5. Latest consensus state: current_term: 1 leader_uuid: "400730fa49014be39013f993706a96a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.609346 26246 sys_catalog.cc:458] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:05.611892 26287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 400730fa49014be39013f993706a96a5. Latest consensus state: current_term: 1 leader_uuid: "400730fa49014be39013f993706a96a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.612043 26287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 06:35:05.615648 26305 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:35:05.615744 26305 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:35:05.617341 26216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.599698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58204 (local address 127.21.195.254:41391)
0810 06:35:05.599803 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.599807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.602339 (+ 2532us) server_negotiation.cc:407] Connection header received
0810 06:35:05.603643 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.603646 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.603697 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.603744 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.606866 (+ 3122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.607679 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.610008 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.610432 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.610538 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.612558 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.612562 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.612565 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.612596 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.615158 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.615735 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.615740 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.615742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.615850 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.616265 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.616269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.616271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.616533 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.616659 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.617021 (+ 362us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.617167 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 06:35:05.622254 26218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:05.599122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49840 (local address 127.21.195.253:40039)
0810 06:35:05.599247 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.599251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.602095 (+ 2844us) server_negotiation.cc:407] Connection header received
0810 06:35:05.602547 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.602551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.602602 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.602652 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.604587 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.605401 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.608842 (+ 3441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:05.609220 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:05.609299 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:05.618423 (+ 9124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:05.618428 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:05.618431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:05.618464 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:05.620227 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.620751 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.620755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.620757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.620851 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:05.621139 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:05.621142 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:05.621144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:05.621387 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:05.621556 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:05.621939 (+ 383us) server_negotiation.cc:299] Negotiation successful
0810 06:35:05.622082 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 06:35:05.629065 26282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "400730fa49014be39013f993706a96a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.629220 26282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:05.629328 26282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "400730fa49014be39013f993706a96a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.629395 26282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:05.629537 26285 mvcc.cc:205] Tried to move back new op lower bound from 7316863818114875392 to 7316863818079399936. Current Snapshot: MvccSnapshot[applied={T|T < 7316863818114875392}]
I20260810 06:35:05.630950 26287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "400730fa49014be39013f993706a96a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.631110 26287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:05.631110 26246 sys_catalog.cc:455] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "400730fa49014be39013f993706a96a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "400730fa49014be39013f993706a96a5" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 41391 } } peers { permanent_uuid: "adb6930ad1fd4867b3d20cd1ef99e3d7" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 40039 } } peers { permanent_uuid: "5e92cb9ed86e44c5b2a345a99d705b20" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 42855 } } }
I20260810 06:35:05.631237 26246 sys_catalog.cc:458] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:05.632490 26311 mvcc.cc:205] Tried to move back new op lower bound from 7316863818114875392 to 7316863818079399936. Current Snapshot: MvccSnapshot[applied={T|T < 7316863818114875392}]
I20260810 06:35:05.637200 26284 catalog_manager.cc:1347] Generated new cluster ID: e45b88156a6240c3a44cc0529f6656c2
I20260810 06:35:05.637303 26284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:35:05.671717 26284 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:35:05.673192 26284 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:35:05.689924 26284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 400730fa49014be39013f993706a96a5: Generated new TSK 0
I20260810 06:35:05.691071 26284 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:35:05.722335 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.718639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49844 (local address 127.21.195.253:40039)
0810 06:35:05.718780 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.718785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.721028 (+ 2243us) server_negotiation.cc:407] Connection header received
0810 06:35:05.721254 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.721258 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.721317 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.721386 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.722172 (+ 786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49844: BlockingRecv error: recv got EOF from 127.0.0.1:49844 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 06:35:05.724175 26216 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.719575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58218 (local address 127.21.195.254:41391)
0810 06:35:05.719700 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.719706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.723120 (+ 3414us) server_negotiation.cc:407] Connection header received
0810 06:35:05.723305 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.723308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.723381 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.723438 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.724033 (+ 595us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58218: BlockingRecv error: recv got EOF from 127.0.0.1:58218 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260810 06:35:05.726372 26212 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.720415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36140 (local address 127.21.195.252:42855)
0810 06:35:05.720571 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.720575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.724790 (+ 4215us) server_negotiation.cc:407] Connection header received
0810 06:35:05.725265 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.725269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.725331 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.725398 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.726214 (+ 816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36140: BlockingRecv error: recv got EOF from 127.0.0.1:36140 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 06:35:05.732118 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.730230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49850 (local address 127.21.195.253:40039)
0810 06:35:05.730369 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.730374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.730967 (+ 593us) server_negotiation.cc:407] Connection header received
0810 06:35:05.731213 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.731216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.731297 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.731365 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.731991 (+ 626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49850: BlockingRecv error: recv got EOF from 127.0.0.1:49850 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 06:35:05.738075 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.736101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49854 (local address 127.21.195.253:40039)
0810 06:35:05.736228 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.736233 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.736906 (+ 673us) server_negotiation.cc:407] Connection header received
0810 06:35:05.737132 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.737136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.737198 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.737257 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.737943 (+ 686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49854: BlockingRecv error: recv got EOF from 127.0.0.1:49854 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 06:35:05.744834 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.742845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.21.195.253:40039)
0810 06:35:05.742978 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.742983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.743657 (+ 674us) server_negotiation.cc:407] Connection header received
0810 06:35:05.743908 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.743912 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.743979 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.744040 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.744694 (+ 654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49864: BlockingRecv error: recv got EOF from 127.0.0.1:49864 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 06:35:05.754073 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.751850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49878 (local address 127.21.195.253:40039)
0810 06:35:05.752051 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.752056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.752812 (+ 756us) server_negotiation.cc:407] Connection header received
0810 06:35:05.753073 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.753078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.753144 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.753208 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.753938 (+ 730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49878: BlockingRecv error: recv got EOF from 127.0.0.1:49878 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
W20260810 06:35:05.768059 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.765972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49884 (local address 127.21.195.253:40039)
0810 06:35:05.766106 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.766111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.766849 (+ 738us) server_negotiation.cc:407] Connection header received
0810 06:35:05.767083 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.767087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.767146 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.767202 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.767917 (+ 715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49884: BlockingRecv error: recv got EOF from 127.0.0.1:49884 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260810 06:35:05.788166 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.786826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49888 (local address 127.21.195.253:40039)
0810 06:35:05.786961 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.786966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.787247 (+ 281us) server_negotiation.cc:407] Connection header received
0810 06:35:05.787376 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.787379 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.787435 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.787510 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.788035 (+ 525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49888: BlockingRecv error: recv got EOF from 127.0.0.1:49888 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260810 06:35:05.823779 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.822618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49894 (local address 127.21.195.253:40039)
0810 06:35:05.822790 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.822795 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.822842 (+ 47us) server_negotiation.cc:407] Connection header received
0810 06:35:05.823002 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.823006 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.823072 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.823179 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.823629 (+ 450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49894: BlockingRecv error: recv got EOF from 127.0.0.1:49894 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260810 06:35:05.891368 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:05.890062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49896 (local address 127.21.195.253:40039)
0810 06:35:05.890230 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:05.890235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:05.890398 (+ 163us) server_negotiation.cc:407] Connection header received
0810 06:35:05.890592 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:05.890596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:05.890651 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:05.890728 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:05.891238 (+ 510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49896: BlockingRecv error: recv got EOF from 127.0.0.1:49896 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260810 06:35:06.022811 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:06.021698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49898 (local address 127.21.195.253:40039)
0810 06:35:06.021843 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:06.021848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:06.021985 (+ 137us) server_negotiation.cc:407] Connection header received
0810 06:35:06.022117 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:06.022120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:06.022174 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:06.022266 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:06.022691 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49898: BlockingRecv error: recv got EOF from 127.0.0.1:49898 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260810 06:35:06.282473 26218 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:06.281301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49904 (local address 127.21.195.253:40039)
0810 06:35:06.281431 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:06.281435 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:06.281539 (+ 104us) server_negotiation.cc:407] Connection header received
0810 06:35:06.281702 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:06.281705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:06.281757 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:06.281843 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:06.282352 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49904: BlockingRecv error: recv got EOF from 127.0.0.1:49904 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 06:35:06.574476 26268 catalog_manager.cc:1259] Loaded cluster ID: e45b88156a6240c3a44cc0529f6656c2
I20260810 06:35:06.574577 26268 catalog_manager.cc:1552] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7: loading cluster ID for follower catalog manager: success
I20260810 06:35:06.576411 26268 catalog_manager.cc:1574] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7: acquiring CA information for follower catalog manager: success
I20260810 06:35:06.577816 26268 catalog_manager.cc:1602] T 00000000000000000000000000000000 P adb6930ad1fd4867b3d20cd1ef99e3d7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:35:06.617237 26305 catalog_manager.cc:1259] Loaded cluster ID: e45b88156a6240c3a44cc0529f6656c2
I20260810 06:35:06.617347 26305 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20: loading cluster ID for follower catalog manager: success
I20260810 06:35:06.619238 26305 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20: acquiring CA information for follower catalog manager: success
I20260810 06:35:06.620646 26305 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5e92cb9ed86e44c5b2a345a99d705b20: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:35:06.801084 26435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:06.796740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.21.195.253:40039)
0810 06:35:06.797013 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:06.797017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:06.797102 (+ 85us) server_negotiation.cc:407] Connection header received
0810 06:35:06.797258 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:06.797261 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:06.797401 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:06.797582 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:06.797875 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.798448 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.799406 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.799650 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.799749 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:06.800115 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:06.800626 (+ 511us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:06.800752 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:06.800838 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 06:35:06.800909 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":84,"threads_started":1}
I20260810 06:35:06.808234 26452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:06.804546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36150 (local address 127.21.195.252:42855)
0810 06:35:06.804785 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:06.804789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:06.804805 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:35:06.804901 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:06.804903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:06.805032 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:06.805145 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:06.805413 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.805981 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.806867 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.807091 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.807162 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:06.807428 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:06.807911 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:06.808008 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:06.808034 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 06:35:06.808091 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":70,"threads_started":1}
I20260810 06:35:06.815677 26435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:06.811796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49928 (local address 127.21.195.253:40039)
0810 06:35:06.811952 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:06.811956 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:06.811969 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:35:06.812016 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:06.812019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:06.812065 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:06.812132 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:06.812468 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.813039 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.814444 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.814742 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.814844 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:06.815151 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:06.815254 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:06.815303 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:06.815463 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 06:35:06.815531 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260810 06:35:06.816138 26452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:06.811817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36154 (local address 127.21.195.252:42855)
0810 06:35:06.811928 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:06.811932 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:06.811945 (+ 13us) server_negotiation.cc:407] Connection header received
0810 06:35:06.811997 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:06.812000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:06.812052 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:06.812132 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:06.812400 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.813098 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.814936 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.815213 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.815312 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:06.815650 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:06.815731 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:06.815772 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:06.815954 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 06:35:06.816015 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 06:35:06.816577 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:06.811477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58224 (local address 127.21.195.254:41391)
0810 06:35:06.812128 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:06.812133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:06.812474 (+ 341us) server_negotiation.cc:407] Connection header received
0810 06:35:06.812593 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:06.812596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:06.812778 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:06.812921 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:06.813143 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.813737 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.814591 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:06.814826 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:06.814926 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:06.815338 (+ 412us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:06.815967 (+ 629us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:06.816070 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:06.816361 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 06:35:06.816426 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":82,"threads_started":1}
I20260810 06:35:06.820606 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25844
I20260810 06:35:06.837285 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 25969
I20260810 06:35:06.853615 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 26083
2026-08-10T06:35:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3341 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 06:35:06 dist-test-slave-7lbf krb5kdc[26467](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 06:35:06 dist-test-slave-7lbf krb5kdc[26467](info): set up 2 sockets
Aug 10 06:35:06 dist-test-slave-7lbf krb5kdc[26467](info): commencing operation
krb5kdc: starting...
W20260810 06:35:08.029989 22287 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/test-user.keytab.
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T06:35:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T06:35:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.195.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
Entry for principal kudu/127.21.195.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab.
I20260810 06:35:08.164489 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:37963
--webserver_interface=127.21.195.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:35275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:37963,127.21.195.253:42061,127.21.195.252:40471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 06:35:08.288341 26488 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:35:08.288709 26488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:08.288749 26488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:08.288815 26488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:08.293160 26488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:08.293251 26488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:08.293280 26488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:08.293303 26488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:08.293321 26488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:08.299180 26488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:35275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:37963,127.21.195.253:42061,127.21.195.252:40471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.254.keytab
--principal=kudu/127.21.195.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.254:37963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.195.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:08.300508 26488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:08.301769 26488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:35:08.311372 26499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:08.311383 26501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:08.311378 26498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:08.311744 26488 server_base.cc:1034] running on GCE node
I20260810 06:35:08.312404 26488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:08.313647 26488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:08.314810 26488 hybrid_clock.cc:648] HybridClock initialized: now 1786343708314796 us; error 38 us; skew 500 ppm
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:08.317891 26488 init.cc:377] Logged in from keytab as kudu/127.21.195.254@KRBTEST.COM (short username kudu)
I20260810 06:35:08.318907 26488 webserver.cc:460] Webserver started at http://127.21.195.254:36177/ using document root <none> and password file <none>
I20260810 06:35:08.319500 26488 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:08.319566 26488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:08.319752 26488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:08.322147 26488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/data/instance:
uuid: "d6e87ffa63464895a807474933cf44a8"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "7868c185f52e24a8cbaf9b8c73077875"
server_key_iv: "326fe217a8aa510616f2c32113095a29"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.322726 26488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/wal/instance:
uuid: "d6e87ffa63464895a807474933cf44a8"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "7868c185f52e24a8cbaf9b8c73077875"
server_key_iv: "326fe217a8aa510616f2c32113095a29"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.326818 26488 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260810 06:35:08.329578 26514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:08.331096 26488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260810 06:35:08.331241 26488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/wal
uuid: "d6e87ffa63464895a807474933cf44a8"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "7868c185f52e24a8cbaf9b8c73077875"
server_key_iv: "326fe217a8aa510616f2c32113095a29"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.331352 26488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:08.343190 26488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:08.346720 26488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:08.346913 26488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:08.354333 26488 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.254:37963
I20260810 06:35:08.354612 26607 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.254:37963 every 8 connection(s)
I20260810 06:35:08.355424 26488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/data/info.pb
I20260810 06:35:08.358690 26610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:08.362847 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 26488
I20260810 06:35:08.362984 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-0/wal/instance
I20260810 06:35:08.363302 22287 external_mini_cluster.cc:1428] Setting key 5242ebafdf040e82e185b1a6592d525f
I20260810 06:35:08.363409 26610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.195.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.253@KRBTEST.COM" created.
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:35:08.381659 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.366564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37963 (local address 127.0.0.1:51756)
0810 06:35:08.367215 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.367255 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.368171 (+ 916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.368989 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.368995 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.369471 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.369783 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.369800 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.370999 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.371002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.371779 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.371788 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.372491 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.372495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.372667 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.373257 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:08.373278 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:08.375970 (+ 2692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:08.378294 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.378307 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.378321 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.378646 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.379048 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.379051 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.379052 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.379174 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.379981 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:08.379988 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:08.380140 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 06:35:08.380299 (+ 159us) client_negotiation.cc:240] Negotiation successful
0810 06:35:08.380625 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":48,"spinlock_wait_cycles":3456,"thread_start_us":197,"threads_started":1}
I20260810 06:35:08.381662 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.366563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51756 (local address 127.21.195.254:37963)
0810 06:35:08.367043 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.367063 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.367374 (+ 311us) server_negotiation.cc:407] Connection header received
0810 06:35:08.368515 (+ 1141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.368520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.368776 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.368975 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.369945 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.370876 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.371909 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.372318 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.372488 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.376193 (+ 3705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.376201 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.376215 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.376243 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.378155 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.378770 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.378777 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.378779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.378957 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.379255 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.379258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.379260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.379850 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.380014 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.380433 (+ 419us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.380724 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":100,"server-negotiator.queue_time_us":323,"thread_start_us":133,"threads_started":1}
I20260810 06:35:08.384754 26610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:08.385622 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.385294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41814)
0810 06:35:08.385433 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.385539 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260810 06:35:08.385843 26517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
I20260810 06:35:08.386794 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.386572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41826)
0810 06:35:08.386684 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.386733 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 06:35:08.386945 26610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:42061: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab.
Entry for principal kudu/127.21.195.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab.
I20260810 06:35:08.393208 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.253:42061
--webserver_interface=127.21.195.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab
--principal=kudu/127.21.195.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:35275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:37963,127.21.195.253:42061,127.21.195.252:40471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:35:08.436210 26610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } attempt: 1
I20260810 06:35:08.437155 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.436809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41830)
0810 06:35:08.436988 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.437066 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 06:35:08.438081 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.437804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41832)
0810 06:35:08.437953 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.438012 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260810 06:35:08.438232 26610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:42061: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
I20260810 06:35:08.506429 26610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } attempt: 2
I20260810 06:35:08.507524 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.507134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41842)
0810 06:35:08.507359 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.507423 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260810 06:35:08.508415 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.508173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41852)
0810 06:35:08.508291 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.508346 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 06:35:08.508558 26610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.253:42061: Network error: Client connection negotiation failed: client connection to 127.21.195.253:42061: connect: Connection refused (error 111)
W20260810 06:35:08.517588 26622 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:35:08.517985 26622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:08.518028 26622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:08.518092 26622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:08.522413 26622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:08.522496 26622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:08.522522 26622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:08.522547 26622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:08.522576 26622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:08.528436 26622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:35275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:37963,127.21.195.253:42061,127.21.195.252:40471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.253.keytab
--principal=kudu/127.21.195.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.253:42061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.195.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:08.529799 26622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:08.531036 26622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:35:08.540685 26633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:08.540794 26622 server_base.cc:1034] running on GCE node
W20260810 06:35:08.540642 26632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:08.540642 26637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:08.541712 26622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:08.543071 26622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:08.544206 26622 hybrid_clock.cc:648] HybridClock initialized: now 1786343708544160 us; error 61 us; skew 500 ppm
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:08.547252 26622 init.cc:377] Logged in from keytab as kudu/127.21.195.253@KRBTEST.COM (short username kudu)
I20260810 06:35:08.548257 26622 webserver.cc:460] Webserver started at http://127.21.195.253:36711/ using document root <none> and password file <none>
I20260810 06:35:08.548866 26622 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:08.548939 26622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:08.549176 26622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:08.551591 26622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/data/instance:
uuid: "1747b4e76a69450f9f3c4d267de8b667"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "9545efe607b9cffc4005afdca09c2bcf"
server_key_iv: "ce956ae860820c411469f61522d578be"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.552235 26622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/wal/instance:
uuid: "1747b4e76a69450f9f3c4d267de8b667"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "9545efe607b9cffc4005afdca09c2bcf"
server_key_iv: "ce956ae860820c411469f61522d578be"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.556468 26622 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260810 06:35:08.559315 26647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:08.560708 26622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260810 06:35:08.560846 26622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/wal
uuid: "1747b4e76a69450f9f3c4d267de8b667"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "9545efe607b9cffc4005afdca09c2bcf"
server_key_iv: "ce956ae860820c411469f61522d578be"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.560972 26622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:08.584239 26622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:08.587742 26622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:08.587967 26622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:08.595335 26622 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.253:42061
I20260810 06:35:08.595593 26731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.253:42061 every 8 connection(s)
I20260810 06:35:08.596460 26622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/data/info.pb
I20260810 06:35:08.599761 26734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:08.599709 26610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } attempt: 3
I20260810 06:35:08.601553 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 26622
I20260810 06:35:08.601679 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-1/wal/instance
I20260810 06:35:08.601951 22287 external_mini_cluster.cc:1428] Setting key bf6fc5cc2d93e5d66a2f85f68ab601e5
I20260810 06:35:08.605551 26734 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.195.252@KRBTEST.COM; defaulting to no policy
I20260810 06:35:08.613041 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.600254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41868)
0810 06:35:08.600436 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.600456 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.600574 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.603353 (+ 2779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.603357 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.603584 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.603755 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.603764 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.605182 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.605185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.605790 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.605804 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.606626 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.606630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.606752 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.607244 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:08.607258 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:08.608829 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:08.611109 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.611113 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.611115 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.611325 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.611650 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.611653 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.611656 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.611748 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.612524 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:08.612527 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:08.612637 (+ 110us) client_negotiation.cc:769] Sending connection context
0810 06:35:08.612733 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 06:35:08.612862 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260810 06:35:08.614277 26736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.601025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41868 (local address 127.21.195.253:42061)
0810 06:35:08.601503 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.601550 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.601598 (+ 48us) server_negotiation.cc:407] Connection header received
0810 06:35:08.602411 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.602440 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.602941 (+ 501us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.603394 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.603964 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.605022 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.605923 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.606480 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.606644 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.609035 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.609040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.609051 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.609079 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.611005 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.611425 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.611432 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.611439 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.611556 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.611830 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.611834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.611836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.612398 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.612545 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.612909 (+ 364us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.613328 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":129,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.195.252@KRBTEST.COM" created.
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:35:08.616633 26610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:08.617509 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.617123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35128)
0810 06:35:08.617358 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.617418 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260810 06:35:08.618263 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.617996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35138)
0810 06:35:08.618147 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.618198 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260810 06:35:08.618499 26610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:40471: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
I20260810 06:35:08.619146 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.607926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51772 (local address 127.21.195.254:37963)
0810 06:35:08.608059 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.608063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.608495 (+ 432us) server_negotiation.cc:407] Connection header received
0810 06:35:08.608719 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.608723 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.608781 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.608869 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.609807 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.610578 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.611909 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.612823 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.612935 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.615778 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.615782 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.615784 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.615809 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.617290 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.617821 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.617825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.617827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.617920 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.618218 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.618222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.618223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.618415 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.618500 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.618891 (+ 391us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.619013 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 06:35:08.619182 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.607771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37963 (local address 127.0.0.1:51772)
0810 06:35:08.608359 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.608416 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.608600 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.608952 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.608959 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.609453 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.609664 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.609672 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.610717 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.610721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.611716 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.611729 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.612957 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.612961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.613130 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.613722 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:08.613734 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:08.615630 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:08.617386 (+ 1756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.617397 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.617403 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.617721 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.618025 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.618028 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.618030 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.618131 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.618524 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:08.618531 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:08.618667 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 06:35:08.618787 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 06:35:08.618993 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":108,"threads_started":1}
I20260810 06:35:08.620293 26734 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:35:08.630143 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.620798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41878)
0810 06:35:08.620999 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.621009 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.621088 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.621273 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.621275 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.621436 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.621572 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.621580 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.622276 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.622279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.622814 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.622821 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.623239 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.623242 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.623381 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.623889 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:08.623899 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:08.627015 (+ 3116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:08.628578 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.628581 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.628582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.628833 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.629046 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.629048 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.629049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.629141 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.629456 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:08.629459 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:08.629678 (+ 219us) client_negotiation.cc:769] Sending connection context
0810 06:35:08.629794 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 06:35:08.629929 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":17}
I20260810 06:35:08.630151 26736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.620840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41878 (local address 127.21.195.253:42061)
0810 06:35:08.620952 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.620956 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.621060 (+ 104us) server_negotiation.cc:407] Connection header received
0810 06:35:08.621153 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.621156 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.621192 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.621254 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.621664 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.622182 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.622912 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.623145 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.623230 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.627155 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.627159 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.627161 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.627185 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.628454 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.628905 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.628908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.628909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.628987 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.629211 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.629213 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.629214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.629383 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.629448 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.629827 (+ 379us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.629991 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":36}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.195.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab.
Entry for principal kudu/127.21.195.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab.
I20260810 06:35:08.631804 26734 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:08.632212 22287 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
/tmp/dist-test-taskvl7b6p/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.252:40471
--webserver_interface=127.21.195.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab
--principal=kudu/127.21.195.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.195.212:35275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.195.254:37963,127.21.195.253:42061,127.21.195.252:40471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 06:35:08.632691 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.632316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35144)
0810 06:35:08.632526 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.632613 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
W20260810 06:35:08.632908 26649 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
I20260810 06:35:08.633879 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.633663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35152)
0810 06:35:08.633759 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.633812 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 06:35:08.634047 26734 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:40471: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
I20260810 06:35:08.649654 26610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } attempt: 1
I20260810 06:35:08.650643 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.650290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35168)
0810 06:35:08.650459 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.650549 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 06:35:08.651454 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.651209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35184)
0810 06:35:08.651320 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.651372 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 06:35:08.651600 26610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:40471: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
I20260810 06:35:08.683382 26734 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } attempt: 1
I20260810 06:35:08.684414 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.684067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35200)
0810 06:35:08.684242 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.684315 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260810 06:35:08.685236 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.684994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35214)
0810 06:35:08.685118 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.685169 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260810 06:35:08.685374 26734 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:40471: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
I20260810 06:35:08.726779 26610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } attempt: 2
I20260810 06:35:08.727787 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.727419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35220)
0810 06:35:08.727608 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.727699 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260810 06:35:08.728607 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.728365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35222)
0810 06:35:08.728481 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.728535 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 06:35:08.728746 26610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:40471: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
I20260810 06:35:08.753549 26734 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } attempt: 2
I20260810 06:35:08.754439 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.754123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35238)
0810 06:35:08.754277 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.754354 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 06:35:08.755302 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.755049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35246)
0810 06:35:08.755172 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.755223 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 06:35:08.755445 26734 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:40471: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
W20260810 06:35:08.756940 26743 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 06:35:08.757282 26743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 06:35:08.757321 26743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 06:35:08.757386 26743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 06:35:08.761703 26743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 06:35:08.761785 26743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 06:35:08.761811 26743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 06:35:08.761837 26743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 06:35:08.761868 26743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 06:35:08.767762 26743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.195.212:35275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.195.254:37963,127.21.195.253:42061,127.21.195.252:40471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/krb5kdc/kudu_127.21.195.252.keytab
--principal=kudu/127.21.195.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.195.252:40471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.195.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 10 Aug 2026 05:31:42 UTC on ccycloud.quasar-clutqi.root.comops.site
build id 4577008
I20260810 06:35:08.769076 26743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 06:35:08.770323 26743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 06:35:08.779834 26754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:08.779834 26760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 06:35:08.779877 26753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 06:35:08.780172 26743 server_base.cc:1034] running on GCE node
I20260810 06:35:08.780872 26743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 06:35:08.782194 26743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 06:35:08.783360 26743 hybrid_clock.cc:648] HybridClock initialized: now 1786343708783338 us; error 37 us; skew 500 ppm
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 06:35:08.786466 26743 init.cc:377] Logged in from keytab as kudu/127.21.195.252@KRBTEST.COM (short username kudu)
I20260810 06:35:08.787842 26743 webserver.cc:460] Webserver started at http://127.21.195.252:41987/ using document root <none> and password file <none>
I20260810 06:35:08.788663 26743 fs_manager.cc:359] Metadata directory not provided
I20260810 06:35:08.788820 26743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 06:35:08.789122 26743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 06:35:08.792179 26743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/data/instance:
uuid: "1c24c651c3084981a7aa77c3efcf5955"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "7183e5fb6a245097ac9566609bb9cd6c"
server_key_iv: "9dfdfcd5f6f12f5e04fa0712788e41f6"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.792910 26743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/wal/instance:
uuid: "1c24c651c3084981a7aa77c3efcf5955"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "7183e5fb6a245097ac9566609bb9cd6c"
server_key_iv: "9dfdfcd5f6f12f5e04fa0712788e41f6"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.797997 26743 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260810 06:35:08.800907 26769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 06:35:08.802352 26743 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260810 06:35:08.802496 26743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/data,/tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/wal
uuid: "1c24c651c3084981a7aa77c3efcf5955"
format_stamp: "Formatted at 2026-08-10 06:35:08 on dist-test-slave-7lbf"
server_key: "7183e5fb6a245097ac9566609bb9cd6c"
server_key_iv: "9dfdfcd5f6f12f5e04fa0712788e41f6"
server_key_version: "encryptionkey@0"
I20260810 06:35:08.802606 26743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 06:35:08.823962 26743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 06:35:08.827916 26610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } attempt: 3
I20260810 06:35:08.828467 26743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 06:35:08.828692 26743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 06:35:08.828830 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.828470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35262)
0810 06:35:08.828653 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.828724 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 06:35:08.829655 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.829384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35268)
0810 06:35:08.829506 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.829585 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 06:35:08.829869 26610 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.195.252:40471: Network error: Client connection negotiation failed: client connection to 127.21.195.252:40471: connect: Connection refused (error 111)
I20260810 06:35:08.836407 26743 rpc_server.cc:307] RPC server started. Bound to: 127.21.195.252:40471
I20260810 06:35:08.836695 26852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.195.252:40471 every 8 connection(s)
I20260810 06:35:08.837639 26743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/data/info.pb
I20260810 06:35:08.840857 26853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 06:35:08.841037 22287 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu as pid 26743
I20260810 06:35:08.841166 22287 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvl7b6p/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786343407647307-22287-0/minicluster-data/master-2/wal/instance
I20260810 06:35:08.841472 22287 external_mini_cluster.cc:1428] Setting key 5ba9cfd1400e7abd86bf4c4ab193e746
I20260810 06:35:08.846604 26734 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } attempt: 3
I20260810 06:35:08.846472 26853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.253@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
I20260810 06:35:08.857242 26738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.847143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35290)
0810 06:35:08.847262 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.847277 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.847360 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.847803 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.847807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.848027 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.848143 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.848151 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.849185 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.849189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.850007 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.850021 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.850628 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.850638 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.850726 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.851169 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:08.851184 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:08.852706 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:08.855257 (+ 2551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.855260 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.855263 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.855475 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.855837 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.855840 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.855842 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.855946 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.856675 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:08.856678 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:08.856788 (+ 110us) client_negotiation.cc:769] Sending connection context
0810 06:35:08.856880 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 06:35:08.857055 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 06:35:08.858557 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.847203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35290 (local address 127.21.195.252:40471)
0810 06:35:08.847577 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.847583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.847594 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:35:08.847624 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.847626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.847659 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.847738 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.848269 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.849010 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.850126 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.850472 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.850599 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.852913 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.852921 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.852935 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.852973 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.855144 (+ 2171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.855578 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.855586 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.855593 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.855751 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.856037 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.856041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.856042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.856567 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.856697 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.857064 (+ 367us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.857406 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":308,"thread_start_us":168,"threads_started":1}
I20260810 06:35:08.858561 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.843036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35284 (local address 127.21.195.252:40471)
0810 06:35:08.843490 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.843512 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.843563 (+ 51us) server_negotiation.cc:407] Connection header received
0810 06:35:08.844531 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.844561 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.845094 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.845508 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.846303 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.847838 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.848899 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.849697 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.849865 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.853397 (+ 3532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.853401 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.853404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.853432 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.855197 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.855771 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.855774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.855776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.855864 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.856181 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.856185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.856186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.856574 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.856752 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.857880 (+ 1128us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.858005 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":282,"spinlock_wait_cycles":19200,"thread_start_us":110,"threads_started":1}
I20260810 06:35:08.860175 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.848869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.254:37963 (local address 127.0.0.1:51788)
0810 06:35:08.849750 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.849806 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.849935 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.850303 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.850310 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.850813 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.850925 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.850930 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.851922 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.851925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.852809 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.852820 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.853541 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.853545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.853651 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.854105 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:08.854120 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:08.856473 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:08.858408 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.858416 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.858434 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.858712 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.859052 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.859055 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.859057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.859142 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.859642 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:08.859647 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:08.859759 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 06:35:08.859897 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 06:35:08.860047 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":87,"threads_started":1}
I20260810 06:35:08.860282 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.848945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51788 (local address 127.21.195.254:37963)
0810 06:35:08.849076 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.849080 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.849886 (+ 806us) server_negotiation.cc:407] Connection header received
0810 06:35:08.850026 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.850030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.850075 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.850149 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.851063 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.851784 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.852920 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.853278 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.853380 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.856654 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.856658 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.856661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.856693 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.858283 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.858835 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.858838 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.858840 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.858937 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.859243 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.859247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.859248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.859487 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.859563 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.860002 (+ 439us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.860133 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 06:35:08.861690 26853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:08.863895 26734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: Bootstrap starting.
I20260810 06:35:08.866780 26734 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: Neither blocks nor log segments found. Creating new log.
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.254@KRBTEST.COM
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:35:08.867801 26734 log.cc:824] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:08.870734 26734 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: No bootstrap required, opened a new log
I20260810 06:35:08.871793 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.862229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.253:42061 (local address 127.0.0.1:41880)
0810 06:35:08.862380 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.862393 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.862475 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.862778 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.862780 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.862914 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.863018 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.863023 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.863812 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.863815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.864613 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.864624 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.865670 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.865674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.865793 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.866292 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:08.866306 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:08.868169 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:08.870035 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.870039 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.870041 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.870300 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.870620 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.870624 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.870626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.870732 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.871233 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:08.871236 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:08.871349 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 06:35:08.871470 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 06:35:08.871626 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260810 06:35:08.871974 26736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.862338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41880 (local address 127.21.195.253:42061)
0810 06:35:08.862463 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.862468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.862483 (+ 15us) server_negotiation.cc:407] Connection header received
0810 06:35:08.862551 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.862554 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.862601 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.862672 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.863133 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.863692 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.864745 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.865075 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.865452 (+ 377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.868355 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.868359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.868361 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.868390 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.869923 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.870410 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.870414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.870416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.870521 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.870884 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.870888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.870890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.871132 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.871230 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.871562 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.871683 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 06:35:08.872428 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.861370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51800 (local address 127.21.195.254:37963)
0810 06:35:08.861491 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.861495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.861661 (+ 166us) server_negotiation.cc:407] Connection header received
0810 06:35:08.861828 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.861832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.861880 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.861952 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.862679 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.863387 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.864350 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.864657 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.864754 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.867801 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.867804 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.867806 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.867831 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.869882 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.870362 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.870365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.870367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.870467 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.870796 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.870799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.870800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.871065 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.872059 (+ 994us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.872151 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.872287 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 06:35:08.872969 26853 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } has no permanent_uuid. Determining permanent_uuid...
I20260810 06:35:08.875018 26734 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } }
I20260810 06:35:08.875293 26734 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1747b4e76a69450f9f3c4d267de8b667, State: Initialized, Role: FOLLOWER
I20260810 06:35:08.875705 26734 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } }
I20260810 06:35:08.876353 26865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:08.876539 26865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:08.877496 26734 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [sys.catalog]: configured and running, proceeding with master startup.
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.252@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
Aug 10 06:35:08 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.195.253@KRBTEST.COM
I20260810 06:35:08.882689 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.873472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35292)
0810 06:35:08.874251 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.874265 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.874355 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.874575 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.874578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.874742 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.874838 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.874844 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.875710 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.875714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.876489 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.876499 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.877019 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.877023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.877104 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.877619 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:08.877633 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:08.879213 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:08.881092 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.881095 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.881097 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.881325 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.881647 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:08.881650 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:08.881652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:08.881729 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:08.882216 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:08.882218 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:08.882303 (+ 85us) client_negotiation.cc:769] Sending connection context
0810 06:35:08.882381 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 06:35:08.882520 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"mutex_wait_us":1}
I20260810 06:35:08.883249 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.873581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35292 (local address 127.21.195.252:40471)
0810 06:35:08.873773 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.873777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.874339 (+ 562us) server_negotiation.cc:407] Connection header received
0810 06:35:08.874428 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.874431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.874472 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.874545 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.874957 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.875610 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.876607 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.876918 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.877006 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.879371 (+ 2365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.879375 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.879378 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.879405 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.880984 (+ 1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.881431 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.881434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.881436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.881510 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.881823 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.881826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.881827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.882119 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.882897 (+ 778us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.882969 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.883092 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 06:35:08.884003 26736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.874091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.21.195.253:42061)
0810 06:35:08.874195 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.874198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.874209 (+ 11us) server_negotiation.cc:407] Connection header received
0810 06:35:08.874238 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.874240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.874273 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.874343 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.875086 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.875788 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.876814 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.877111 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.877210 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:08.880345 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:08.880349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:08.880352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:08.880381 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:08.881904 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.882396 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.882400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.882402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.882502 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:08.882953 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:08.882956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:08.882958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:08.883172 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:08.883331 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:08.883718 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 06:35:08.883859 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 06:35:08.882582 26622 master_runner.cc:186] Error getting master registration for 127.21.195.254:37963: OK, instance_id { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" instance_seqno: 1786343708352317 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:35:08.886381 26622 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:35:08.886647 26853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: Bootstrap starting.
I20260810 06:35:08.888589 22287 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 06:35:08.889374 26853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: Neither blocks nor log segments found. Creating new log.
I20260810 06:35:08.890260 26853 log.cc:824] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:08.889951 26555 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d6e87ffa63464895a807474933cf44a8"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51800
W20260810 06:35:08.891752 26883 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:35:08.891830 26883 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:35:08.893183 26853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: No bootstrap required, opened a new log
I20260810 06:35:08.896449 26853 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } }
I20260810 06:35:08.896713 26853 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c24c651c3084981a7aa77c3efcf5955, State: Initialized, Role: FOLLOWER
I20260810 06:35:08.897060 26853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } }
I20260810 06:35:08.897771 26888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:08.898065 26888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:08.898540 26853 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 06:35:08.904362 26905 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 06:35:08.904544 26905 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 06:35:08.902801 26743 master_runner.cc:186] Error getting master registration for 127.21.195.254:37963: OK, instance_id { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" instance_seqno: 1786343708352317 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 06:35:08.906270 26743 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:35:08.994024 26610 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } attempt: 4
Aug 10 06:35:09 dist-test-slave-7lbf krb5kdc[26467](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786343708, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.195.254@KRBTEST.COM for kudu/127.21.195.252@KRBTEST.COM
I20260810 06:35:09.009390 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.994731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.195.252:40471 (local address 127.0.0.1:35294)
0810 06:35:08.994984 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0810 06:35:08.995001 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 06:35:08.995121 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 06:35:08.995451 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 06:35:08.995454 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 06:35:08.995696 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 06:35:08.995870 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.995878 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.996980 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.996985 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.997834 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 06:35:08.997850 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.998483 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.998487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 06:35:08.998585 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:09.003339 (+ 4754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 06:35:09.003358 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0810 06:35:09.005159 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 06:35:09.007590 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:09.007594 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:09.007597 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:09.007907 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:09.008230 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 06:35:09.008233 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 06:35:09.008235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 06:35:09.008335 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 06:35:09.008777 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 06:35:09.008787 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 06:35:09.008911 (+ 124us) client_negotiation.cc:769] Sending connection context
0810 06:35:09.009023 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 06:35:09.009194 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260810 06:35:09.009402 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:08.994840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35294 (local address 127.21.195.252:40471)
0810 06:35:08.995002 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:08.995007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:08.995081 (+ 74us) server_negotiation.cc:407] Connection header received
0810 06:35:08.995242 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:08.995246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:08.995302 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:08.995406 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:08.996029 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.996834 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.997969 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:08.998330 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:08.998437 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:09.005394 (+ 6957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:09.005399 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:09.005402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:09.005438 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:09.007440 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:09.008024 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:09.008028 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:09.008030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:09.008136 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:09.008430 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:09.008433 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:09.008435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:09.008686 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:09.008789 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:09.009097 (+ 308us) server_negotiation.cc:299] Negotiation successful
0810 06:35:09.009245 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 06:35:09.013769 26610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8: Bootstrap starting.
I20260810 06:35:09.017076 26610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8: Neither blocks nor log segments found. Creating new log.
I20260810 06:35:09.018144 26610 log.cc:824] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8: Log is configured to *not* fsync() on all Append() calls
I20260810 06:35:09.021008 26610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8: No bootstrap required, opened a new log
I20260810 06:35:09.024613 26610 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } }
I20260810 06:35:09.024957 26610 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e87ffa63464895a807474933cf44a8, State: Initialized, Role: FOLLOWER
I20260810 06:35:09.025379 26610 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } }
I20260810 06:35:09.026212 26910 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:09.026531 26910 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:09.027195 26610 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 06:35:09.027247 26555 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 06:35:09.027374 26555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:09.028838 26555 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } }
I20260810 06:35:09.030247 26555 leader_election.cc:288] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [CANDIDATE]: Term 1 election: Requested vote from peers 1747b4e76a69450f9f3c4d267de8b667 (127.21.195.253:42061), 1c24c651c3084981a7aa77c3efcf5955 (127.21.195.252:40471)
I20260810 06:35:09.031175 26691 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6e87ffa63464895a807474933cf44a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1747b4e76a69450f9f3c4d267de8b667"
I20260810 06:35:09.031502 26691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:09.031823 26817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6e87ffa63464895a807474933cf44a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1c24c651c3084981a7aa77c3efcf5955"
I20260810 06:35:09.032091 26817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [term 0 FOLLOWER]: Advancing to term 1
I20260810 06:35:09.032975 26691 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e87ffa63464895a807474933cf44a8 in term 1.
I20260810 06:35:09.033505 26817 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e87ffa63464895a807474933cf44a8 in term 1.
I20260810 06:35:09.033584 26517 leader_election.cc:302] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1747b4e76a69450f9f3c4d267de8b667, d6e87ffa63464895a807474933cf44a8; no voters:
I20260810 06:35:09.033955 26910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 06:35:09.034207 26910 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [term 1 LEADER]: Becoming Leader. State: Replica: d6e87ffa63464895a807474933cf44a8, State: Running, Role: LEADER
I20260810 06:35:09.034581 26910 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } }
I20260810 06:35:09.036661 26910 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e87ffa63464895a807474933cf44a8. Latest consensus state: current_term: 1 leader_uuid: "d6e87ffa63464895a807474933cf44a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:09.036783 26910 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:09.037533 26939 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 06:35:09.042454 26488 master_runner.cc:263] No leader master found from master d6e87ffa63464895a807474933cf44a8
I20260810 06:35:09.042567 26488 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 06:35:09.042485 26939 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 06:35:09.055073 26817 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [term 1 FOLLOWER]: Refusing update from remote peer d6e87ffa63464895a807474933cf44a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:35:09.056087 26691 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [term 1 FOLLOWER]: Refusing update from remote peer d6e87ffa63464895a807474933cf44a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 06:35:09.057137 26910 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:35:09.057663 26927 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 06:35:09.060145 26736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:09.043698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41906 (local address 127.21.195.253:42061)
0810 06:35:09.043845 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.043849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.049907 (+ 6058us) server_negotiation.cc:407] Connection header received
0810 06:35:09.050146 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.050150 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.050208 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.050261 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.051414 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:09.052214 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:09.053360 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:09.053742 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:09.053859 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:09.055770 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:09.055774 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:09.055788 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:09.055820 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:09.057640 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:09.058524 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:09.058528 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:09.058529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:09.058654 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:09.059119 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:09.059122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:09.059124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:09.059371 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:09.059482 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:09.059854 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 06:35:09.059989 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 06:35:09.074658 26614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:09.043028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51806 (local address 127.21.195.254:37963)
0810 06:35:09.043150 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.043155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.049907 (+ 6752us) server_negotiation.cc:407] Connection header received
0810 06:35:09.050160 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.050164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.050220 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.050279 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.054081 (+ 3802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:09.054758 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:09.055806 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:09.056113 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:09.056197 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:09.070221 (+ 14024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:09.070227 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:09.070230 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:09.070267 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:09.072119 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:09.072699 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:09.072704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:09.072706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:09.072818 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:09.073162 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:09.073166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:09.073168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:09.073449 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:09.074249 (+ 800us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:09.074349 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 06:35:09.074487 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 06:35:09.075747 26865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e87ffa63464895a807474933cf44a8. Latest consensus state: current_term: 1 leader_uuid: "d6e87ffa63464895a807474933cf44a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:09.075927 26865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:09.077914 26888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6e87ffa63464895a807474933cf44a8. Latest consensus state: current_term: 1 leader_uuid: "d6e87ffa63464895a807474933cf44a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:09.078070 26888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:09.079231 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:09.044173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35298 (local address 127.21.195.252:40471)
0810 06:35:09.044305 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.044309 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.052614 (+ 8305us) server_negotiation.cc:407] Connection header received
0810 06:35:09.052797 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.052801 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.052872 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.052928 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.062025 (+ 9097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:09.062777 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:09.066998 (+ 4221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:09.067326 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:09.067439 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:09.069661 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 06:35:09.069666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 06:35:09.069669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 06:35:09.069709 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0810 06:35:09.073130 (+ 3421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:09.076064 (+ 2934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:09.076068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:09.076071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:09.076173 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 06:35:09.076445 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 06:35:09.076448 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 06:35:09.076449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 06:35:09.076666 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 06:35:09.076803 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:09.078924 (+ 2121us) server_negotiation.cc:299] Negotiation successful
0810 06:35:09.079062 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 06:35:09.080462 26778 tablet.cc:2369] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 06:35:09.089725 26655 tablet.cc:2369] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 06:35:09.090878 26927 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6e87ffa63464895a807474933cf44a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:09.091048 26927 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:09.091156 26927 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d6e87ffa63464895a807474933cf44a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:09.091228 26927 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8 [sys.catalog]: This master's current role is: LEADER
I20260810 06:35:09.092058 26865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6e87ffa63464895a807474933cf44a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:09.092209 26865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:09.094244 26939 catalog_manager.cc:1347] Generated new cluster ID: 84721c1dd3724734897a9b2fe376bcb5
I20260810 06:35:09.094322 26939 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 06:35:09.094643 26951 mvcc.cc:205] Tried to move back new op lower bound from 7316863832279220224 to 7316863832209551360. Current Snapshot: MvccSnapshot[applied={T|T < 7316863832279220224}]
I20260810 06:35:09.095438 26888 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d6e87ffa63464895a807474933cf44a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e87ffa63464895a807474933cf44a8" member_type: VOTER last_known_addr { host: "127.21.195.254" port: 37963 } } peers { permanent_uuid: "1747b4e76a69450f9f3c4d267de8b667" member_type: VOTER last_known_addr { host: "127.21.195.253" port: 42061 } } peers { permanent_uuid: "1c24c651c3084981a7aa77c3efcf5955" member_type: VOTER last_known_addr { host: "127.21.195.252" port: 40471 } } }
I20260810 06:35:09.095569 26888 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 06:35:09.096205 26955 mvcc.cc:205] Tried to move back new op lower bound from 7316863832279220224 to 7316863832209551360. Current Snapshot: MvccSnapshot[applied={T|T < 7316863832279220224}]
I20260810 06:35:09.117609 26939 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 06:35:09.118741 26939 catalog_manager.cc:1504] Loading token signing keys...
I20260810 06:35:09.129967 26939 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6e87ffa63464895a807474933cf44a8: Generated new TSK 0
I20260810 06:35:09.131106 26939 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 06:35:09.162036 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.160304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41912 (local address 127.21.195.253:42061)
0810 06:35:09.160575 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.160580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.160773 (+ 193us) server_negotiation.cc:407] Connection header received
0810 06:35:09.161005 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.161008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.161062 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.161116 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.161885 (+ 769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41912: BlockingRecv error: recv got EOF from 127.0.0.1:41912 (error 108)
Metrics: {"server-negotiator.queue_time_us":180}
W20260810 06:35:09.162036 26614 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.160297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51822 (local address 127.21.195.254:37963)
0810 06:35:09.160455 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.160460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.160773 (+ 313us) server_negotiation.cc:407] Connection header received
0810 06:35:09.161006 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.161009 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.161062 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.161116 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.161895 (+ 779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51822: BlockingRecv error: recv got EOF from 127.0.0.1:51822 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260810 06:35:09.162859 26860 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.160947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35304 (local address 127.21.195.252:40471)
0810 06:35:09.161067 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.161071 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.161575 (+ 504us) server_negotiation.cc:407] Connection header received
0810 06:35:09.161763 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.161766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.161829 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.161881 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.162728 (+ 847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35304: BlockingRecv error: recv got EOF from 127.0.0.1:35304 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260810 06:35:09.165719 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.164603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41922 (local address 127.21.195.253:42061)
0810 06:35:09.164725 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.164729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.164831 (+ 102us) server_negotiation.cc:407] Connection header received
0810 06:35:09.165003 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.165006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.165088 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.165158 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.165587 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41922: BlockingRecv error: recv got EOF from 127.0.0.1:41922 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260810 06:35:09.169987 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.169093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41938 (local address 127.21.195.253:42061)
0810 06:35:09.169202 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.169205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.169217 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:35:09.169263 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.169265 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.169307 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.169389 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.169873 (+ 484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41938: BlockingRecv error: recv got EOF from 127.0.0.1:41938 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 06:35:09.175125 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.173986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41940 (local address 127.21.195.253:42061)
0810 06:35:09.174091 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.174095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.174313 (+ 218us) server_negotiation.cc:407] Connection header received
0810 06:35:09.174446 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.174448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.174495 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.174563 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.175006 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41940: BlockingRecv error: recv got EOF from 127.0.0.1:41940 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260810 06:35:09.182557 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.181325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41950 (local address 127.21.195.253:42061)
0810 06:35:09.181505 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.181510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.181626 (+ 116us) server_negotiation.cc:407] Connection header received
0810 06:35:09.181822 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.181826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.181879 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.181953 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.182426 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41950: BlockingRecv error: recv got EOF from 127.0.0.1:41950 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
W20260810 06:35:09.194346 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.193108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41956 (local address 127.21.195.253:42061)
0810 06:35:09.193280 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.193285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.193404 (+ 119us) server_negotiation.cc:407] Connection header received
0810 06:35:09.193558 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.193562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.193630 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.193739 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.194208 (+ 469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41956: BlockingRecv error: recv got EOF from 127.0.0.1:41956 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260810 06:35:09.213853 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.212569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41972 (local address 127.21.195.253:42061)
0810 06:35:09.212732 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.212737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.212897 (+ 160us) server_negotiation.cc:407] Connection header received
0810 06:35:09.213031 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.213034 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.213100 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.213196 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.213703 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41972: BlockingRecv error: recv got EOF from 127.0.0.1:41972 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260810 06:35:09.249804 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.248567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41982 (local address 127.21.195.253:42061)
0810 06:35:09.248773 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.248777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.248866 (+ 89us) server_negotiation.cc:407] Connection header received
0810 06:35:09.249004 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.249006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.249063 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.249149 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.249626 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41982: BlockingRecv error: recv got EOF from 127.0.0.1:41982 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260810 06:35:09.317426 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.316130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41986 (local address 127.21.195.253:42061)
0810 06:35:09.316311 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.316315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.316431 (+ 116us) server_negotiation.cc:407] Connection header received
0810 06:35:09.316564 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.316567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.316624 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.316723 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.317301 (+ 578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41986: BlockingRecv error: recv got EOF from 127.0.0.1:41986 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260810 06:35:09.449230 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.447932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42002 (local address 127.21.195.253:42061)
0810 06:35:09.448110 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.448116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.448270 (+ 154us) server_negotiation.cc:407] Connection header received
0810 06:35:09.448404 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.448406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.448464 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.448552 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.449084 (+ 532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42002: BlockingRecv error: recv got EOF from 127.0.0.1:42002 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260810 06:35:09.709004 26736 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 06:35:09.707751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42004 (local address 127.21.195.253:42061)
0810 06:35:09.707915 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:09.707919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:09.707939 (+ 20us) server_negotiation.cc:407] Connection header received
0810 06:35:09.708116 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:09.708119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:09.708171 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:09.708246 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 06:35:09.708855 (+ 609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42004: BlockingRecv error: recv got EOF from 127.0.0.1:42004 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260810 06:35:09.893410 26883 catalog_manager.cc:1259] Loaded cluster ID: 84721c1dd3724734897a9b2fe376bcb5
I20260810 06:35:09.893558 26883 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: loading cluster ID for follower catalog manager: success
I20260810 06:35:09.895334 26883 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: acquiring CA information for follower catalog manager: success
I20260810 06:35:09.896693 26883 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1747b4e76a69450f9f3c4d267de8b667: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:35:09.906308 26905 catalog_manager.cc:1259] Loaded cluster ID: 84721c1dd3724734897a9b2fe376bcb5
I20260810 06:35:09.906404 26905 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: loading cluster ID for follower catalog manager: success
I20260810 06:35:09.908309 26905 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: acquiring CA information for follower catalog manager: success
I20260810 06:35:09.909713 26905 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1c24c651c3084981a7aa77c3efcf5955: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 06:35:10.227505 27078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:10.223385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42010 (local address 127.21.195.253:42061)
0810 06:35:10.223650 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:10.223654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:10.223671 (+ 17us) server_negotiation.cc:407] Connection header received
0810 06:35:10.223798 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:10.223801 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:10.223961 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:10.224070 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:10.224395 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.224954 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.225907 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.226147 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.226222 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:10.226519 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:10.227051 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:10.227202 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:10.227255 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 06:35:10.227324 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":95,"threads_started":1}
I20260810 06:35:10.235239 27093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:10.230967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35316 (local address 127.21.195.252:40471)
0810 06:35:10.231307 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:10.231310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:10.231326 (+ 16us) server_negotiation.cc:407] Connection header received
0810 06:35:10.231501 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:10.231503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:10.231636 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:10.231750 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:10.232024 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.232584 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.233544 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.233832 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.233940 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:10.234262 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:10.234810 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:10.234922 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:10.234981 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 06:35:10.235045 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":102,"threads_started":1}
I20260810 06:35:10.242642 27078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:10.238626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42016 (local address 127.21.195.253:42061)
0810 06:35:10.238780 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:10.238785 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:10.238913 (+ 128us) server_negotiation.cc:407] Connection header received
0810 06:35:10.239132 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:10.239136 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:10.239201 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:10.239251 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:10.239583 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.240255 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.241267 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.241661 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.241768 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:10.242093 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:10.242193 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:10.242262 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:10.242412 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 06:35:10.242483 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 06:35:10.242882 27093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:10.239258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35320 (local address 127.21.195.252:40471)
0810 06:35:10.239404 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:10.239408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:10.239420 (+ 12us) server_negotiation.cc:407] Connection header received
0810 06:35:10.239465 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:10.239468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:10.239510 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:10.239579 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:10.239924 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.240700 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.241730 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.242049 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.242152 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:10.242444 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:10.242532 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:10.242599 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:10.242692 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 06:35:10.242751 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 06:35:10.243577 27102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 06:35:10.238610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51824 (local address 127.21.195.254:37963)
0810 06:35:10.238862 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 06:35:10.238866 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 06:35:10.239101 (+ 235us) server_negotiation.cc:407] Connection header received
0810 06:35:10.239369 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 06:35:10.239373 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 06:35:10.239577 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 06:35:10.239707 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 06:35:10.239989 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.240792 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.241837 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 06:35:10.242192 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 06:35:10.242287 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 06:35:10.242624 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 06:35:10.243155 (+ 531us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 06:35:10.243232 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 06:35:10.243351 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 06:35:10.243424 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":72,"threads_started":1}
I20260810 06:35:10.246693 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 26488
I20260810 06:35:10.270187 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 26622
I20260810 06:35:10.288160 22287 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvl7b6p/build/debug/bin/kudu with pid 26743
2026-08-10T06:35:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3434 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6776 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (302602 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST